Oct 26 15:44:08 user nova-compute[74646]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74646) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74646) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74646) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 26 15:44:08 user nova-compute[74646]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:44:08 user nova-compute[74646]: INFO nova.virt.driver [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 26 15:44:08 user nova-compute[74646]: INFO nova.compute.provider_config [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] Acquiring lock "singleton_lock" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] Acquired lock "singleton_lock" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] Releasing lock "singleton_lock" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] Full set of CONF: {{(pid=74646) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ******************************************************************************** {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] Configuration options gathered from: {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ================================================================================ {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] allow_resize_to_same_host      = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] arq_binding_timeout            = 300 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] backdoor_port                  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] backdoor_socket                = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] block_device_allocate_retries  = 300 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] block_device_allocate_retries_interval = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cert                           = self.pem {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] compute_monitors               = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] config_dir                     = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] config_drive_format            = iso9660 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] config_source                  = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] console_host                   = user {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] control_exchange               = nova {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cpu_allocation_ratio           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] daemon                         = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] debug                          = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] default_access_ip_network_name = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] default_availability_zone      = nova {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] default_ephemeral_format       = ext4 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] default_green_pool_size        = 1000 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] default_schedule_zone          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] disk_allocation_ratio          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] enable_new_services            = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] enabled_ssl_apis               = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] flat_injected                  = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] force_config_drive             = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] force_raw_images               = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] graceful_shutdown_timeout      = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] heal_instance_info_cache_interval = 60 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] host                           = user {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] instance_build_timeout         = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] instance_delete_interval       = 300 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] instance_name_template         = instance-%08x {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] instance_usage_audit           = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] instance_usage_audit_period    = month {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] internal_service_availability_zone = internal {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] key                            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] live_migration_retry_count     = 30 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] log_config_append              = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] log_dir                        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] log_file                       = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] log_options                    = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] log_rotate_interval            = 1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] log_rotate_interval_type       = days {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] log_rotation_type              = none {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] long_rpc_timeout               = 1800 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] max_concurrent_builds          = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] max_concurrent_live_migrations = 1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] max_concurrent_snapshots       = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] max_local_block_devices        = 3 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] max_logfile_count              = 30 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] max_logfile_size_mb            = 200 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] maximum_instance_delete_attempts = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] metadata_listen                = 0.0.0.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] metadata_listen_port           = 8775 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] metadata_workers               = 3 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] migrate_max_retries            = -1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] mkisofs_cmd                    = genisoimage {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] my_ip                          = 10.0.0.210 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] network_allocate_retries       = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] osapi_compute_listen_port      = 8774 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] osapi_compute_unique_server_name_scope =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] osapi_compute_workers          = 3 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] password_length                = 12 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] periodic_enable                = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] periodic_fuzzy_delay           = 60 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] pointer_model                  = ps2mouse {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] preallocate_images             = none {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] publish_errors                 = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] pybasedir                      = /opt/stack/nova {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ram_allocation_ratio           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] rate_limit_burst               = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] rate_limit_except_level        = CRITICAL {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] rate_limit_interval            = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] reboot_timeout                 = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] reclaim_instance_interval      = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] record                         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] reimage_timeout_per_gb         = 60 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] report_interval                = 120 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] rescue_timeout                 = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] reserved_host_cpus             = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] reserved_host_disk_mb          = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] reserved_host_memory_mb        = 512 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] reserved_huge_pages            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] resize_confirm_window          = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] resize_fs_using_block_device   = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] resume_guests_state_on_host_boot = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] rpc_response_timeout           = 60 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] run_external_periodic_tasks    = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] running_deleted_instance_action = reap {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] running_deleted_instance_timeout = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] scheduler_instance_sync_interval = 120 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] service_down_time              = 720 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] servicegroup_driver            = db {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] shelved_offload_time           = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] shelved_poll_interval          = 3600 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] shutdown_timeout               = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] source_is_ipv6                 = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ssl_only                       = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] state_path                     = /opt/stack/data/nova {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] sync_power_state_interval      = 600 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] sync_power_state_pool_size     = 1000 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] syslog_log_facility            = LOG_USER {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] tempdir                        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] timeout_nbd                    = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] transport_url                  = **** {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] update_resources_interval      = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] use_cow_images                 = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] use_eventlog                   = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] use_journal                    = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] use_json                       = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] use_rootwrap_daemon            = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] use_stderr                     = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] use_syslog                     = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vcpu_pin_set                   = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vif_plugging_is_fatal          = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vif_plugging_timeout           = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] virt_mkfs                      = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] volume_usage_poll_interval     = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] watch_log_file                 = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] web                            = /usr/share/spice-html5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_concurrency.disable_process_locking = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.auth_strategy              = keystone {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.compute_link_prefix        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.dhcp_domain                = novalocal {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.enable_instance_password   = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.glance_link_prefix         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.instance_list_per_project_cells = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.list_records_by_skipping_down_cells = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.local_metadata_per_cell    = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.max_limit                  = 1000 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.metadata_cache_expiration  = 15 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.neutron_default_tenant_id  = default {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.use_forwarded_for          = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.use_neutron_default_nets   = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.vendordata_dynamic_targets = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.vendordata_jsonfile_path   = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.backend_argument         = **** {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.config_prefix            = cache.oslo {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.dead_timeout             = 60.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.debug_cache_backend      = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.enable_retry_client      = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.enable_socket_keepalive  = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.enabled                  = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.expiration_time          = 600 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.hashclient_retry_attempts = 2 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.memcache_dead_retry      = 300 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.memcache_password        =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.memcache_sasl_enabled    = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.memcache_username        =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.proxies                  = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.retry_attempts           = 2 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.retry_delay              = 0.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.socket_keepalive_count   = 1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.socket_keepalive_idle    = 1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.socket_keepalive_interval = 1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.tls_allowed_ciphers      = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.tls_cafile               = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.tls_certfile             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.tls_enabled              = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cache.tls_keyfile              = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.auth_section            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.auth_type               = password {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.cafile                  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.certfile                = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.collect_timing          = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.cross_az_attach         = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.debug                   = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.endpoint_template       = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.http_retries            = 3 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.insecure                = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.keyfile                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.os_region_name          = RegionOne {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.split_loggers           = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cinder.timeout                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] compute.cpu_dedicated_set      = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] compute.cpu_shared_set         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] compute.image_type_exclude_list = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] compute.resource_provider_association_refresh = 300 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] compute.shutdown_retry_interval = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] conductor.workers              = 3 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] console.allowed_origins        = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] console.ssl_ciphers            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] console.ssl_minimum_version    = default {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] consoleauth.token_ttl          = 600 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.cafile                  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.certfile                = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.collect_timing          = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.connect_retries         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.connect_retry_delay     = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.endpoint_override       = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.insecure                = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.keyfile                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.max_version             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.min_version             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.region_name             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.service_name            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.service_type            = accelerator {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.split_loggers           = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.status_code_retries     = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.status_code_retry_delay = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.timeout                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] cyborg.version                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.backend               = sqlalchemy {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.connection            = **** {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.connection_debug      = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.connection_parameters =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.connection_recycle_time = 3600 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.connection_trace      = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.db_inc_retry_interval = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.db_max_retries        = 20 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.db_max_retry_interval = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.db_retry_interval     = 1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.max_overflow          = 50 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.max_pool_size         = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.max_retries           = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.mysql_wsrep_sync_wait = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.pool_timeout          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.retry_interval        = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.slave_connection      = **** {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] database.sqlite_synchronous    = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.backend           = sqlalchemy {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.connection        = **** {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.connection_debug  = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.connection_parameters =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.connection_recycle_time = 3600 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.connection_trace  = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.db_inc_retry_interval = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.db_max_retries    = 20 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.db_max_retry_interval = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.db_retry_interval = 1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.max_overflow      = 50 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.max_pool_size     = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.max_retries       = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.pool_timeout      = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.retry_interval    = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.slave_connection  = **** {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] api_database.sqlite_synchronous = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] devices.enabled_mdev_types     = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ephemeral_storage_encryption.enabled = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.api_servers             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.cafile                  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.certfile                = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.collect_timing          = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.connect_retries         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.connect_retry_delay     = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.debug                   = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.default_trusted_certificate_ids = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.enable_certificate_validation = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.enable_rbd_download     = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.endpoint_override       = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.insecure                = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.keyfile                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.max_version             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.min_version             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.num_retries             = 3 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.rbd_ceph_conf           =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.rbd_connect_timeout     = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.rbd_pool                =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.rbd_user                =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.region_name             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.service_name            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.service_type            = image {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.split_loggers           = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.status_code_retries     = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.status_code_retry_delay = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.timeout                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.verify_glance_signatures = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] glance.version                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] guestfs.debug                  = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.config_drive_cdrom      = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.config_drive_inject_password = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.enable_remotefx         = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.instances_path_share    =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.limit_cpu_features      = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.use_multipath_io        = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.vswitch_name            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] mks.enabled                    = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] image_cache.manager_interval   = 2400 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] image_cache.precache_concurrency = 1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] image_cache.remove_unused_base_images = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] image_cache.subdirectory_name  = _base {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.api_max_retries         = 60 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.api_retry_interval      = 2 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.auth_section            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.auth_type               = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.cafile                  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.certfile                = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.collect_timing          = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.conductor_group         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.connect_retries         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.connect_retry_delay     = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.endpoint_override       = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.insecure                = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.keyfile                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.max_version             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.min_version             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.peer_list               = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.region_name             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.serial_console_state_timeout = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.service_name            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.service_type            = baremetal {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.split_loggers           = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.status_code_retries     = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.status_code_retry_delay = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.timeout                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ironic.version                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] key_manager.fixed_key          = **** {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.barbican_api_version  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.barbican_endpoint     = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.barbican_endpoint_type = public {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.barbican_region_name  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.cafile                = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.certfile              = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.collect_timing        = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.insecure              = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.keyfile               = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.number_of_retries     = 60 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.retry_delay           = 1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.send_service_user_token = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.split_loggers         = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.timeout               = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.verify_ssl            = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican.verify_ssl_path       = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican_service_user.auth_section = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican_service_user.auth_type = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican_service_user.cafile   = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican_service_user.certfile = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican_service_user.collect_timing = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican_service_user.insecure = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican_service_user.keyfile  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican_service_user.split_loggers = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] barbican_service_user.timeout  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.approle_role_id          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.approle_secret_id        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.cafile                   = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.certfile                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.collect_timing           = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.insecure                 = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.keyfile                  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.kv_mountpoint            = secret {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.kv_path                  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.kv_version               = 2 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.namespace                = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.root_token_id            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.split_loggers            = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.ssl_ca_crt_file          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.timeout                  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.use_ssl                  = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.auth_section          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.auth_type             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.cafile                = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.certfile              = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.collect_timing        = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.connect_retries       = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.connect_retry_delay   = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.endpoint_override     = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.insecure              = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.keyfile               = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.max_version           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.min_version           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.region_name           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.service_name          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.service_type          = identity {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.split_loggers         = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.status_code_retries   = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.status_code_retry_delay = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.timeout               = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] keystone.version               = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.connection_uri         =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.cpu_mode               = custom {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: WARNING oslo_config.cfg [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.cpu_power_governor_high = performance {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.cpu_power_management   = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.device_detach_attempts = 8 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.device_detach_timeout  = 20 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.disk_cachemodes        = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.disk_prefix            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.enabled_perf_events    = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.file_backed_memory     = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.gid_maps               = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.hw_disk_discard        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.hw_machine_type        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.images_rbd_pool        = rbd {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.images_type            = default {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.images_volume_group    = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.inject_key             = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.inject_partition       = -2 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.inject_password        = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.iscsi_iface            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.iser_use_multipath     = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.live_migration_downtime = 500 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.live_migration_inbound_addr = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.live_migration_scheme  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.live_migration_timeout_action = abort {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.live_migration_tunnelled = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: WARNING oslo_config.cfg [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 26 15:44:08 user nova-compute[74646]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 26 15:44:08 user nova-compute[74646]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 26 15:44:08 user nova-compute[74646]: and ``live_migration_inbound_addr`` respectively.
Oct 26 15:44:08 user nova-compute[74646]: ).  Its value may be silently ignored in the future.
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.live_migration_with_native_tls = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.max_queues             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.nfs_mount_options      = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.num_pcie_ports         = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.pmem_namespaces        = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.quobyte_client_cfg     = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.rbd_secret_uuid        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.rbd_user               = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.rescue_image_id        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.rescue_kernel_id       = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.rx_queue_size          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.smbfs_mount_options    =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.snapshot_compression   = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.snapshot_image_format  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.sparse_logical_volumes = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.swtpm_enabled          = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.swtpm_group            = tss {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.swtpm_user             = tss {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.sysinfo_serial         = unique {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.tb_cache_size          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.tx_queue_size          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.uid_maps               = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.use_virtio_for_bridges = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.virt_type              = kvm {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.volume_clear           = zero {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.volume_clear_size      = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.volume_use_multipath   = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.vzstorage_cache_path   = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.auth_section           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.auth_type              = password {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.cafile                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.certfile               = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.collect_timing         = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.connect_retries        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.connect_retry_delay    = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.default_floating_pool  = public {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.endpoint_override      = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.extension_sync_interval = 600 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.http_retries           = 3 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.insecure               = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.keyfile                = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.max_version            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.min_version            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.ovs_bridge             = br-int {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.physnets               = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.region_name            = RegionOne {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.service_metadata_proxy = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.service_name           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.service_type           = network {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.split_loggers          = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.status_code_retries    = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.status_code_retry_delay = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.timeout                = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] neutron.version                = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] notifications.bdms_in_notifications = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] notifications.default_level    = INFO {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] notifications.notification_format = unversioned {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] notifications.notify_on_state_change = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] pci.alias                      = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] pci.device_spec                = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] pci.report_in_placement        = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.auth_section         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.auth_type            = password {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.cafile               = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.certfile             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.collect_timing       = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.connect_retries      = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.connect_retry_delay  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.default_domain_id    = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.default_domain_name  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.domain_id            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.domain_name          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.endpoint_override    = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.insecure             = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.keyfile              = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.max_version          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.min_version          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.password             = **** {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.project_domain_id    = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.project_domain_name  = Default {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.project_id           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.project_name         = service {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.region_name          = RegionOne {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.service_name         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.service_type         = placement {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.split_loggers        = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.status_code_retries  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.status_code_retry_delay = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.system_scope         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.timeout              = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.trust_id             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.user_domain_id       = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.user_domain_name     = Default {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.user_id              = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.username             = placement {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] placement.version              = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] quota.cores                    = 20 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] quota.count_usage_from_placement = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] quota.injected_file_content_bytes = 10240 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] quota.injected_file_path_length = 255 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] quota.injected_files           = 5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] quota.instances                = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] quota.key_pairs                = 100 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] quota.metadata_items           = 128 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] quota.ram                      = 51200 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] quota.recheck_quota            = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] quota.server_group_members     = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] quota.server_groups            = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] rdp.enabled                    = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] scheduler.image_metadata_prefilter = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] scheduler.max_attempts         = 3 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] scheduler.max_placement_results = 1000 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] scheduler.workers              = 3 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.host_subset_size = 1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.isolated_hosts = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.isolated_images = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.pci_in_placement = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.track_instance_changes = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] metrics.required               = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] metrics.weight_multiplier      = 1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] metrics.weight_setting         = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] serial_console.enabled         = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] serial_console.port_range      = 10000:20000 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] serial_console.serialproxy_port = 6083 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] service_user.auth_section      = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] service_user.auth_type         = password {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] service_user.cafile            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] service_user.certfile          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] service_user.collect_timing    = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] service_user.insecure          = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] service_user.keyfile           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] service_user.send_service_user_token = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] service_user.split_loggers     = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] service_user.timeout           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] spice.agent_enabled            = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] spice.enabled                  = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] spice.html5proxy_port          = 6082 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] spice.image_compression        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] spice.jpeg_compression         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] spice.playback_compression     = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] spice.server_listen            = 127.0.0.1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] spice.streaming_mode           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] spice.zlib_compression         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] upgrade_levels.baseapi         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] upgrade_levels.cert            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] upgrade_levels.compute         = auto {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] upgrade_levels.conductor       = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] upgrade_levels.scheduler       = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vendordata_dynamic_auth.cafile = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vendordata_dynamic_auth.certfile = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vendordata_dynamic_auth.insecure = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vendordata_dynamic_auth.timeout = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.api_retry_count         = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.ca_file                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.cache_prefix            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.cluster_name            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.connection_pool_size    = 10 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.console_delay_seconds   = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.datastore_regex         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.host_ip                 = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.host_password           = **** {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.host_port               = 443 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.host_username           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.insecure                = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.integration_bridge      = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.maximum_objects         = 100 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.pbm_default_policy      = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.pbm_enabled             = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.pbm_wsdl_location       = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.serial_port_proxy_uri   = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.serial_port_service_uri = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.task_poll_interval      = 0.5 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.use_linked_clone        = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.vnc_keymap              = en-us {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.vnc_port                = 5900 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vmware.vnc_port_total          = 10000 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vnc.auth_schemes               = ['none'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vnc.enabled                    = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vnc.novncproxy_port            = 6080 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vnc.vencrypt_ca_certs          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vnc.vencrypt_client_cert       = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vnc.vencrypt_client_key        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.disable_rootwrap   = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.enable_numa_live_migration = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.libvirt_disable_apic = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] wsgi.client_socket_timeout     = 900 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] wsgi.default_pool_size         = 1000 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] wsgi.keep_alive                = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] wsgi.max_header_line           = 16384 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] wsgi.ssl_ca_file               = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] wsgi.ssl_cert_file             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] wsgi.ssl_key_file              = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] wsgi.tcp_keepidle              = 600 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] zvm.ca_file                    = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:08 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] zvm.cloud_connector_url        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] zvm.reachable_timeout          = 300 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_policy.enforce_new_defaults = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_policy.enforce_scope      = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_policy.policy_default_rule = default {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] profiler.connection_string     = messaging:// {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] profiler.enabled               = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] profiler.es_doc_type           = notification {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] profiler.es_scroll_size        = 10000 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] profiler.es_scroll_time        = 2m {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] profiler.filter_error_trace    = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] profiler.hmac_keys             = **** {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] profiler.sentinel_service_name = mymaster {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] profiler.socket_timeout        = 0.1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] profiler.trace_requests        = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] profiler.trace_sqlalchemy      = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] profiler_jaeger.process_tags   = {} {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] profiler_jaeger.service_name_prefix = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] profiler_otlp.service_name_prefix = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] remote_debug.host              = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] remote_debug.port              = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_notifications.retry = -1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.auth_section        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.auth_type           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.cafile              = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.certfile            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.collect_timing      = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.connect_retries     = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.connect_retry_delay = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.endpoint_id         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.endpoint_override   = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.insecure            = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.keyfile             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.max_version         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.min_version         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.region_name         = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.service_name        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.service_type        = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.split_loggers       = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.status_code_retries = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.status_code_retry_delay = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.timeout             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.valid_interfaces    = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_limit.version             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_reports.file_event_handler = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] oslo_reports.log_dir           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vif_plug_ovs_privileged.group  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] vif_plug_ovs_privileged.user   = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_ovs.isolate_vif         = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] os_brick.lock_path             = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] privsep_osbrick.capabilities   = [21] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] privsep_osbrick.group          = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] privsep_osbrick.helper_command = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] privsep_osbrick.user           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] nova_sys_admin.group           = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] nova_sys_admin.helper_command  = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] nova_sys_admin.user            = None {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG oslo_service.service [None req-2a9a7ed1-3583-49fb-a1bc-d38a18901639 None None] ******************************************************************************** {{(pid=74646) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 26 15:44:09 user nova-compute[74646]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 26 15:44:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Connecting to libvirt: qemu:///system {{(pid=74646) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7ff9e87766b0> {{(pid=74646) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 26 15:44:09 user nova-compute[74646]: libvirt:  error : internal error: could not initialize domain event timer
Oct 26 15:44:09 user nova-compute[74646]: WARNING nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 26 15:44:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7ff9e87766b0> {{(pid=74646) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Starting native event thread {{(pid=74646) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Starting green dispatch thread {{(pid=74646) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 26 15:44:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Starting connection event dispatch thread {{(pid=74646) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 26 15:44:09 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Connection event '1' reason 'None'
Oct 26 15:44:09 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 26 15:44:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.mount [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Initialising _HostMountState generation 0 {{(pid=74646) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 26 15:44:16 user nova-compute[74646]: INFO nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Libvirt host capabilities <capabilities>
Oct 26 15:44:16 user nova-compute[74646]:   <host>
Oct 26 15:44:16 user nova-compute[74646]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 26 15:44:16 user nova-compute[74646]:     <cpu>
Oct 26 15:44:16 user nova-compute[74646]:       <arch>x86_64</arch>
Oct 26 15:44:16 user nova-compute[74646]:       <model>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <vendor>Intel</vendor>
Oct 26 15:44:16 user nova-compute[74646]:       <microcode version='1070'/>
Oct 26 15:44:16 user nova-compute[74646]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 26 15:44:16 user nova-compute[74646]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature name='ss'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature name='vmx'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature name='pcid'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature name='osxsave'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature name='hypervisor'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature name='arat'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature name='tsc_adjust'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature name='md-clear'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature name='stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature name='arch-capabilities'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature name='ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature name='invtsc'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature name='rsba'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature name='skip-l1dfl-vmentry'/>
Oct 26 15:44:16 user nova-compute[74646]:       <pages unit='KiB' size='4'/>
Oct 26 15:44:16 user nova-compute[74646]:       <pages unit='KiB' size='2048'/>
Oct 26 15:44:16 user nova-compute[74646]:     </cpu>
Oct 26 15:44:16 user nova-compute[74646]:     <power_management>
Oct 26 15:44:16 user nova-compute[74646]:       <suspend_mem/>
Oct 26 15:44:16 user nova-compute[74646]:       <suspend_disk/>
Oct 26 15:44:16 user nova-compute[74646]:       <suspend_hybrid/>
Oct 26 15:44:16 user nova-compute[74646]:     </power_management>
Oct 26 15:44:16 user nova-compute[74646]:     <iommu support='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     <migration_features>
Oct 26 15:44:16 user nova-compute[74646]:       <live/>
Oct 26 15:44:16 user nova-compute[74646]:       <uri_transports>
Oct 26 15:44:16 user nova-compute[74646]:         <uri_transport>tcp</uri_transport>
Oct 26 15:44:16 user nova-compute[74646]:         <uri_transport>rdma</uri_transport>
Oct 26 15:44:16 user nova-compute[74646]:       </uri_transports>
Oct 26 15:44:16 user nova-compute[74646]:     </migration_features>
Oct 26 15:44:16 user nova-compute[74646]:     <topology>
Oct 26 15:44:16 user nova-compute[74646]:       <cells num='2'>
Oct 26 15:44:16 user nova-compute[74646]:         <cell id='0'>
Oct 26 15:44:16 user nova-compute[74646]:           <memory unit='KiB'>8189224</memory>
Oct 26 15:44:16 user nova-compute[74646]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 26 15:44:16 user nova-compute[74646]:           <pages unit='KiB' size='2048'>0</pages>
Oct 26 15:44:16 user nova-compute[74646]:           <distances>
Oct 26 15:44:16 user nova-compute[74646]:             <sibling id='0' value='10'/>
Oct 26 15:44:16 user nova-compute[74646]:             <sibling id='1' value='20'/>
Oct 26 15:44:16 user nova-compute[74646]:           </distances>
Oct 26 15:44:16 user nova-compute[74646]:           <cpus num='6'>
Oct 26 15:44:16 user nova-compute[74646]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 26 15:44:16 user nova-compute[74646]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 26 15:44:16 user nova-compute[74646]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 26 15:44:16 user nova-compute[74646]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 26 15:44:16 user nova-compute[74646]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 26 15:44:16 user nova-compute[74646]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 26 15:44:16 user nova-compute[74646]:           </cpus>
Oct 26 15:44:16 user nova-compute[74646]:         </cell>
Oct 26 15:44:16 user nova-compute[74646]:         <cell id='1'>
Oct 26 15:44:16 user nova-compute[74646]:           <memory unit='KiB'>8206460</memory>
Oct 26 15:44:16 user nova-compute[74646]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 26 15:44:16 user nova-compute[74646]:           <pages unit='KiB' size='2048'>0</pages>
Oct 26 15:44:16 user nova-compute[74646]:           <distances>
Oct 26 15:44:16 user nova-compute[74646]:             <sibling id='0' value='20'/>
Oct 26 15:44:16 user nova-compute[74646]:             <sibling id='1' value='10'/>
Oct 26 15:44:16 user nova-compute[74646]:           </distances>
Oct 26 15:44:16 user nova-compute[74646]:           <cpus num='6'>
Oct 26 15:44:16 user nova-compute[74646]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 26 15:44:16 user nova-compute[74646]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 26 15:44:16 user nova-compute[74646]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 26 15:44:16 user nova-compute[74646]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 26 15:44:16 user nova-compute[74646]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 26 15:44:16 user nova-compute[74646]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 26 15:44:16 user nova-compute[74646]:           </cpus>
Oct 26 15:44:16 user nova-compute[74646]:         </cell>
Oct 26 15:44:16 user nova-compute[74646]:       </cells>
Oct 26 15:44:16 user nova-compute[74646]:     </topology>
Oct 26 15:44:16 user nova-compute[74646]:     <cache>
Oct 26 15:44:16 user nova-compute[74646]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 26 15:44:16 user nova-compute[74646]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 26 15:44:16 user nova-compute[74646]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 26 15:44:16 user nova-compute[74646]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 26 15:44:16 user nova-compute[74646]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 26 15:44:16 user nova-compute[74646]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 26 15:44:16 user nova-compute[74646]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 26 15:44:16 user nova-compute[74646]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 26 15:44:16 user nova-compute[74646]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 26 15:44:16 user nova-compute[74646]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 26 15:44:16 user nova-compute[74646]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 26 15:44:16 user nova-compute[74646]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 26 15:44:16 user nova-compute[74646]:     </cache>
Oct 26 15:44:16 user nova-compute[74646]:     <secmodel>
Oct 26 15:44:16 user nova-compute[74646]:       <model>apparmor</model>
Oct 26 15:44:16 user nova-compute[74646]:       <doi>0</doi>
Oct 26 15:44:16 user nova-compute[74646]:     </secmodel>
Oct 26 15:44:16 user nova-compute[74646]:     <secmodel>
Oct 26 15:44:16 user nova-compute[74646]:       <model>dac</model>
Oct 26 15:44:16 user nova-compute[74646]:       <doi>0</doi>
Oct 26 15:44:16 user nova-compute[74646]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 26 15:44:16 user nova-compute[74646]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 26 15:44:16 user nova-compute[74646]:     </secmodel>
Oct 26 15:44:16 user nova-compute[74646]:   </host>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='alpha'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>64</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>clipper</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='armv6l'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>spitz</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>nuri</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>kzm</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sx1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>z2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>tosa</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>n810</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>n800</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>terrier</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>midway</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>microbit</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>verdex</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>highbank</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>akita</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>connex</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>collie</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='armv7l'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>spitz</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>nuri</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>kzm</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sx1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>z2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>tosa</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>n810</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>n800</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>terrier</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>midway</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>microbit</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>verdex</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>highbank</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>akita</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>connex</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>collie</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='aarch64'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>64</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>integratorcp</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>borzoi</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>spitz</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>nuri</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>musca-b1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>versatileab</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>kzm</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>musca-a</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>smdkc210</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sx1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>z2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>tosa</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>sabrelite</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>realview-eb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>n810</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>n800</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>versatilepb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>terrier</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mainstone</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>midway</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>musicpal</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>microbit</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>cubieboard</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>verdex</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>netduino2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>raspi3b</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>raspi2b</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>cheetah</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>highbank</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>akita</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>connex</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>collie</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>raspi0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <acpi default='on' toggle='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='cris'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='i686'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>x-remote</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>isapc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>microvm</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='kvm'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <pae/>
Oct 26 15:44:16 user nova-compute[74646]:       <nonpae/>
Oct 26 15:44:16 user nova-compute[74646]:       <acpi default='on' toggle='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:       <apic default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='m68k'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>an5206</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>q800</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>next-cube</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='microblaze'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='microblazeel'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='mips'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='16'>malta</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='mipsel'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='16'>malta</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='mips64'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>64</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='16'>malta</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>pica61</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>magnum</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='mips64el'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>64</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='16'>malta</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mipssim</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>pica61</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>magnum</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='16'>boston</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='ppc'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mac99</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>40p</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>taihu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='ppc64'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>64</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2048'>powernv9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>taihu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2048'>powernv10</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>40p</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mac99</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2048'>powernv8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='ppc64le'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>64</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2048'>powernv9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>taihu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2048'>powernv10</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>ppce500</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>40p</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>pegasos2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>bamboo</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>g3beige</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>mac99</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sam460ex</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>ref405ep</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2048'>powernv8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='riscv32'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='8'>spike</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>opentitan</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='5'>sifive_u</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sifive_e</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='8'>virt</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='riscv64'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>64</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='8'>spike</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='5'>sifive_u</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>shakti_c</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sifive_e</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='8'>virt</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='s390x'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>64</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='sh4'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>shix</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>r2d</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='sh4eb'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>64</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>shix</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>r2d</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='sparc'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>SS-5</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>SS-20</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>LX</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>SS-4</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>SS-10</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>Voyager</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='sparc64'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>64</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sun4u</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>niagara</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>sun4v</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='x86_64'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>64</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>x-remote</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='1'>isapc</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>microvm</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='kvm'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <acpi default='on' toggle='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:       <apic default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='xtensa'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>sim</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>kc705</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>ml605</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>virt</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>lx200</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>lx60</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]:   <guest>
Oct 26 15:44:16 user nova-compute[74646]:     <os_type>hvm</os_type>
Oct 26 15:44:16 user nova-compute[74646]:     <arch name='xtensaeb'>
Oct 26 15:44:16 user nova-compute[74646]:       <wordsize>32</wordsize>
Oct 26 15:44:16 user nova-compute[74646]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='4'>sim</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>kc705</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>ml605</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>virt</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>lx200</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>lx60</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 26 15:44:16 user nova-compute[74646]:       <domain type='qemu'/>
Oct 26 15:44:16 user nova-compute[74646]:     </arch>
Oct 26 15:44:16 user nova-compute[74646]:     <features>
Oct 26 15:44:16 user nova-compute[74646]:       <cpuselection/>
Oct 26 15:44:16 user nova-compute[74646]:       <deviceboot/>
Oct 26 15:44:16 user nova-compute[74646]:       <disksnapshot default='on' toggle='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     </features>
Oct 26 15:44:16 user nova-compute[74646]:   </guest>
Oct 26 15:44:16 user nova-compute[74646]: </capabilities>
Oct 26 15:44:16 user nova-compute[74646]: 
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 26 15:44:16 user nova-compute[74646]: <domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 15:44:16 user nova-compute[74646]:   <domain>kvm</domain>
Oct 26 15:44:16 user nova-compute[74646]:   <machine>pc-i440fx-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:   <arch>i686</arch>
Oct 26 15:44:16 user nova-compute[74646]:   <vcpu max='255'/>
Oct 26 15:44:16 user nova-compute[74646]:   <iothreads supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:   <os supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='firmware'/>
Oct 26 15:44:16 user nova-compute[74646]:     <loader supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>rom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pflash</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='readonly'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>yes</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='secure'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </loader>
Oct 26 15:44:16 user nova-compute[74646]:   </os>
Oct 26 15:44:16 user nova-compute[74646]:   <cpu>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-passthrough' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='hostPassthroughMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='maximum' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='maximumMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>on</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-model' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <vendor>Intel</vendor>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ss'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='vmx'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='pcid'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='hypervisor'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arat'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='umip'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='md-clear'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibpb'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibrs'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='erms'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='lm'/>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='custom' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>qemu64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>qemu32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>phenom</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>n270</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>kvm64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>kvm32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>coreduo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>core2duo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>athlon</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Westmere</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Snowridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Penryn</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G5</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G4</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G1</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Nehalem</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Rome</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Milan</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Dhyana</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cooperlake</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Conroe</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>486</model>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:   </cpu>
Oct 26 15:44:16 user nova-compute[74646]:   <memoryBacking supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='sourceType'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>file</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>anonymous</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>memfd</value>
Oct 26 15:44:16 user nova-compute[74646]:     </enum>
Oct 26 15:44:16 user nova-compute[74646]:   </memoryBacking>
Oct 26 15:44:16 user nova-compute[74646]:   <devices>
Oct 26 15:44:16 user nova-compute[74646]:     <disk supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='diskDevice'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>disk</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cdrom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>floppy</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>lun</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='bus'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>ide</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>fdc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sata</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </disk>
Oct 26 15:44:16 user nova-compute[74646]:     <graphics supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sdl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vnc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>spice</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egl-headless</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </graphics>
Oct 26 15:44:16 user nova-compute[74646]:     <video supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='modelType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cirrus</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vmvga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>qxl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>none</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>bochs</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>ramfb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </video>
Oct 26 15:44:16 user nova-compute[74646]:     <hostdev supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='mode'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>subsystem</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='startupPolicy'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>default</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>mandatory</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>requisite</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>optional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='subsysType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pci</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='capsType'/>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='pciBackend'/>
Oct 26 15:44:16 user nova-compute[74646]:     </hostdev>
Oct 26 15:44:16 user nova-compute[74646]:     <rng supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>random</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egd</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>builtin</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </rng>
Oct 26 15:44:16 user nova-compute[74646]:     <filesystem supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='driverType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>path</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>handle</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtiofs</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </filesystem>
Oct 26 15:44:16 user nova-compute[74646]:     <tpm supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-tis</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-crb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>passthrough</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>emulator</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </tpm>
Oct 26 15:44:16 user nova-compute[74646]:   </devices>
Oct 26 15:44:16 user nova-compute[74646]:   <features>
Oct 26 15:44:16 user nova-compute[74646]:     <gic supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     <vmcoreinfo supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <genid supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backingStoreInput supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backup supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <sev supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:   </features>
Oct 26 15:44:16 user nova-compute[74646]: </domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:  {{(pid=74646) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 26 15:44:16 user nova-compute[74646]: <domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 15:44:16 user nova-compute[74646]:   <domain>kvm</domain>
Oct 26 15:44:16 user nova-compute[74646]:   <machine>pc-q35-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:   <arch>i686</arch>
Oct 26 15:44:16 user nova-compute[74646]:   <vcpu max='288'/>
Oct 26 15:44:16 user nova-compute[74646]:   <iothreads supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:   <os supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='firmware'/>
Oct 26 15:44:16 user nova-compute[74646]:     <loader supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>rom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pflash</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='readonly'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>yes</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='secure'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </loader>
Oct 26 15:44:16 user nova-compute[74646]:   </os>
Oct 26 15:44:16 user nova-compute[74646]:   <cpu>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-passthrough' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='hostPassthroughMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='maximum' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='maximumMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>on</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-model' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <vendor>Intel</vendor>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ss'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='vmx'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='pcid'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='hypervisor'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arat'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='umip'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='md-clear'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibpb'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibrs'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='erms'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='lm'/>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='custom' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>qemu64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>qemu32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>phenom</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>n270</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>kvm64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>kvm32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>coreduo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>core2duo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>athlon</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Westmere</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Snowridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Penryn</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G5</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G4</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G1</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Nehalem</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Rome</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Milan</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Dhyana</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cooperlake</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Conroe</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>486</model>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:   </cpu>
Oct 26 15:44:16 user nova-compute[74646]:   <memoryBacking supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='sourceType'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>file</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>anonymous</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>memfd</value>
Oct 26 15:44:16 user nova-compute[74646]:     </enum>
Oct 26 15:44:16 user nova-compute[74646]:   </memoryBacking>
Oct 26 15:44:16 user nova-compute[74646]:   <devices>
Oct 26 15:44:16 user nova-compute[74646]:     <disk supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='diskDevice'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>disk</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cdrom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>floppy</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>lun</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='bus'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>fdc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sata</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </disk>
Oct 26 15:44:16 user nova-compute[74646]:     <graphics supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sdl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vnc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>spice</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egl-headless</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </graphics>
Oct 26 15:44:16 user nova-compute[74646]:     <video supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='modelType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cirrus</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vmvga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>qxl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>none</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>bochs</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>ramfb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </video>
Oct 26 15:44:16 user nova-compute[74646]:     <hostdev supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='mode'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>subsystem</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='startupPolicy'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>default</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>mandatory</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>requisite</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>optional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='subsysType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pci</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='capsType'/>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='pciBackend'/>
Oct 26 15:44:16 user nova-compute[74646]:     </hostdev>
Oct 26 15:44:16 user nova-compute[74646]:     <rng supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>random</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egd</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>builtin</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </rng>
Oct 26 15:44:16 user nova-compute[74646]:     <filesystem supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='driverType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>path</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>handle</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtiofs</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </filesystem>
Oct 26 15:44:16 user nova-compute[74646]:     <tpm supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-tis</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-crb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>passthrough</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>emulator</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </tpm>
Oct 26 15:44:16 user nova-compute[74646]:   </devices>
Oct 26 15:44:16 user nova-compute[74646]:   <features>
Oct 26 15:44:16 user nova-compute[74646]:     <gic supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     <vmcoreinfo supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <genid supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backingStoreInput supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backup supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <sev supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:   </features>
Oct 26 15:44:16 user nova-compute[74646]: </domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:  {{(pid=74646) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 26 15:44:16 user nova-compute[74646]: <domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 15:44:16 user nova-compute[74646]:   <domain>kvm</domain>
Oct 26 15:44:16 user nova-compute[74646]:   <machine>pc-i440fx-jammy</machine>
Oct 26 15:44:16 user nova-compute[74646]:   <arch>i686</arch>
Oct 26 15:44:16 user nova-compute[74646]:   <vcpu max='255'/>
Oct 26 15:44:16 user nova-compute[74646]:   <iothreads supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:   <os supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='firmware'/>
Oct 26 15:44:16 user nova-compute[74646]:     <loader supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>rom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pflash</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='readonly'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>yes</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='secure'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </loader>
Oct 26 15:44:16 user nova-compute[74646]:   </os>
Oct 26 15:44:16 user nova-compute[74646]:   <cpu>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-passthrough' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='hostPassthroughMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='maximum' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='maximumMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>on</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-model' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <vendor>Intel</vendor>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ss'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='vmx'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='pcid'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='hypervisor'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arat'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='umip'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='md-clear'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibpb'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibrs'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='erms'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='lm'/>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='custom' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>qemu64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>qemu32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>phenom</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>n270</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>kvm64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>kvm32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>coreduo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>core2duo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>athlon</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Westmere</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Snowridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Penryn</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G5</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G4</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G1</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Nehalem</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Rome</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Milan</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Dhyana</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cooperlake</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Conroe</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>486</model>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:   </cpu>
Oct 26 15:44:16 user nova-compute[74646]:   <memoryBacking supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='sourceType'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>file</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>anonymous</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>memfd</value>
Oct 26 15:44:16 user nova-compute[74646]:     </enum>
Oct 26 15:44:16 user nova-compute[74646]:   </memoryBacking>
Oct 26 15:44:16 user nova-compute[74646]:   <devices>
Oct 26 15:44:16 user nova-compute[74646]:     <disk supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='diskDevice'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>disk</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cdrom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>floppy</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>lun</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='bus'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>ide</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>fdc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sata</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </disk>
Oct 26 15:44:16 user nova-compute[74646]:     <graphics supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sdl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vnc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>spice</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egl-headless</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </graphics>
Oct 26 15:44:16 user nova-compute[74646]:     <video supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='modelType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cirrus</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vmvga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>qxl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>none</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>bochs</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>ramfb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </video>
Oct 26 15:44:16 user nova-compute[74646]:     <hostdev supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='mode'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>subsystem</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='startupPolicy'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>default</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>mandatory</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>requisite</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>optional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='subsysType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pci</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='capsType'/>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='pciBackend'/>
Oct 26 15:44:16 user nova-compute[74646]:     </hostdev>
Oct 26 15:44:16 user nova-compute[74646]:     <rng supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>random</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egd</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>builtin</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </rng>
Oct 26 15:44:16 user nova-compute[74646]:     <filesystem supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='driverType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>path</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>handle</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtiofs</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </filesystem>
Oct 26 15:44:16 user nova-compute[74646]:     <tpm supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-tis</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-crb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>passthrough</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>emulator</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </tpm>
Oct 26 15:44:16 user nova-compute[74646]:   </devices>
Oct 26 15:44:16 user nova-compute[74646]:   <features>
Oct 26 15:44:16 user nova-compute[74646]:     <gic supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     <vmcoreinfo supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <genid supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backingStoreInput supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backup supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <sev supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:   </features>
Oct 26 15:44:16 user nova-compute[74646]: </domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:  {{(pid=74646) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 26 15:44:16 user nova-compute[74646]: <domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:   <path>/usr/bin/qemu-system-i386</path>
Oct 26 15:44:16 user nova-compute[74646]:   <domain>kvm</domain>
Oct 26 15:44:16 user nova-compute[74646]:   <machine>pc-q35-jammy</machine>
Oct 26 15:44:16 user nova-compute[74646]:   <arch>i686</arch>
Oct 26 15:44:16 user nova-compute[74646]:   <vcpu max='288'/>
Oct 26 15:44:16 user nova-compute[74646]:   <iothreads supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:   <os supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='firmware'/>
Oct 26 15:44:16 user nova-compute[74646]:     <loader supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>rom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pflash</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='readonly'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>yes</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='secure'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </loader>
Oct 26 15:44:16 user nova-compute[74646]:   </os>
Oct 26 15:44:16 user nova-compute[74646]:   <cpu>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-passthrough' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='hostPassthroughMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='maximum' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='maximumMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>on</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-model' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <vendor>Intel</vendor>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ss'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='vmx'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='pcid'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='hypervisor'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arat'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='umip'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='md-clear'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibpb'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibrs'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='erms'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='lm'/>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='custom' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>qemu64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>qemu32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>phenom</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>n270</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>kvm64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>kvm32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>coreduo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>core2duo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>athlon</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Westmere-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Westmere</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Snowridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Penryn</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G5</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G4</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G1</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Nehalem-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Nehalem</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Rome</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Milan</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Dhyana</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cooperlake</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Conroe</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>486</model>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:   </cpu>
Oct 26 15:44:16 user nova-compute[74646]:   <memoryBacking supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='sourceType'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>file</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>anonymous</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>memfd</value>
Oct 26 15:44:16 user nova-compute[74646]:     </enum>
Oct 26 15:44:16 user nova-compute[74646]:   </memoryBacking>
Oct 26 15:44:16 user nova-compute[74646]:   <devices>
Oct 26 15:44:16 user nova-compute[74646]:     <disk supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='diskDevice'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>disk</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cdrom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>floppy</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>lun</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='bus'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>fdc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sata</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </disk>
Oct 26 15:44:16 user nova-compute[74646]:     <graphics supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sdl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vnc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>spice</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egl-headless</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </graphics>
Oct 26 15:44:16 user nova-compute[74646]:     <video supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='modelType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cirrus</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vmvga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>qxl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>none</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>bochs</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>ramfb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </video>
Oct 26 15:44:16 user nova-compute[74646]:     <hostdev supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='mode'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>subsystem</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='startupPolicy'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>default</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>mandatory</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>requisite</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>optional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='subsysType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pci</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='capsType'/>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='pciBackend'/>
Oct 26 15:44:16 user nova-compute[74646]:     </hostdev>
Oct 26 15:44:16 user nova-compute[74646]:     <rng supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>random</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egd</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>builtin</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </rng>
Oct 26 15:44:16 user nova-compute[74646]:     <filesystem supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='driverType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>path</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>handle</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtiofs</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </filesystem>
Oct 26 15:44:16 user nova-compute[74646]:     <tpm supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-tis</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-crb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>passthrough</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>emulator</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </tpm>
Oct 26 15:44:16 user nova-compute[74646]:   </devices>
Oct 26 15:44:16 user nova-compute[74646]:   <features>
Oct 26 15:44:16 user nova-compute[74646]:     <gic supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     <vmcoreinfo supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <genid supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backingStoreInput supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backup supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <sev supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:   </features>
Oct 26 15:44:16 user nova-compute[74646]: </domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:  {{(pid=74646) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu', 'ubuntu-q35'} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 26 15:44:16 user nova-compute[74646]: <domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 15:44:16 user nova-compute[74646]:   <domain>kvm</domain>
Oct 26 15:44:16 user nova-compute[74646]:   <machine>pc-i440fx-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:   <arch>x86_64</arch>
Oct 26 15:44:16 user nova-compute[74646]:   <vcpu max='255'/>
Oct 26 15:44:16 user nova-compute[74646]:   <iothreads supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:   <os supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='firmware'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>efi</value>
Oct 26 15:44:16 user nova-compute[74646]:     </enum>
Oct 26 15:44:16 user nova-compute[74646]:     <loader supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>rom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pflash</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='readonly'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>yes</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='secure'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </loader>
Oct 26 15:44:16 user nova-compute[74646]:   </os>
Oct 26 15:44:16 user nova-compute[74646]:   <cpu>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-passthrough' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='hostPassthroughMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>on</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='maximum' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='maximumMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>on</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-model' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <vendor>Intel</vendor>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ss'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='vmx'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='pcid'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='hypervisor'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arat'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='umip'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='md-clear'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='invtsc'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibpb'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibrs'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='rsba'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='erms'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='custom' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>qemu64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>qemu32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>phenom</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>n270</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>kvm64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>kvm32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>coreduo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>core2duo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>athlon</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Westmere</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Snowridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Penryn</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G5</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G4</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Opteron_G1</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Nehalem</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Rome</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Milan</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Dhyana</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cooperlake</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Conroe</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>486</model>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:   </cpu>
Oct 26 15:44:16 user nova-compute[74646]:   <memoryBacking supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='sourceType'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>file</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>anonymous</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>memfd</value>
Oct 26 15:44:16 user nova-compute[74646]:     </enum>
Oct 26 15:44:16 user nova-compute[74646]:   </memoryBacking>
Oct 26 15:44:16 user nova-compute[74646]:   <devices>
Oct 26 15:44:16 user nova-compute[74646]:     <disk supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='diskDevice'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>disk</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cdrom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>floppy</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>lun</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='bus'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>ide</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>fdc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sata</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </disk>
Oct 26 15:44:16 user nova-compute[74646]:     <graphics supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sdl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vnc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>spice</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egl-headless</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </graphics>
Oct 26 15:44:16 user nova-compute[74646]:     <video supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='modelType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cirrus</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vmvga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>qxl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>none</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>bochs</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>ramfb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </video>
Oct 26 15:44:16 user nova-compute[74646]:     <hostdev supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='mode'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>subsystem</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='startupPolicy'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>default</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>mandatory</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>requisite</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>optional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='subsysType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pci</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='capsType'/>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='pciBackend'/>
Oct 26 15:44:16 user nova-compute[74646]:     </hostdev>
Oct 26 15:44:16 user nova-compute[74646]:     <rng supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>random</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egd</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>builtin</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </rng>
Oct 26 15:44:16 user nova-compute[74646]:     <filesystem supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='driverType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>path</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>handle</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtiofs</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </filesystem>
Oct 26 15:44:16 user nova-compute[74646]:     <tpm supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-tis</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-crb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>passthrough</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>emulator</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </tpm>
Oct 26 15:44:16 user nova-compute[74646]:   </devices>
Oct 26 15:44:16 user nova-compute[74646]:   <features>
Oct 26 15:44:16 user nova-compute[74646]:     <gic supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     <vmcoreinfo supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <genid supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backingStoreInput supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backup supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <sev supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:   </features>
Oct 26 15:44:16 user nova-compute[74646]: </domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:  {{(pid=74646) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 26 15:44:16 user nova-compute[74646]: <domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 15:44:16 user nova-compute[74646]:   <domain>kvm</domain>
Oct 26 15:44:16 user nova-compute[74646]:   <machine>pc-q35-6.2</machine>
Oct 26 15:44:16 user nova-compute[74646]:   <arch>x86_64</arch>
Oct 26 15:44:16 user nova-compute[74646]:   <vcpu max='288'/>
Oct 26 15:44:16 user nova-compute[74646]:   <iothreads supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:   <os supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='firmware'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>efi</value>
Oct 26 15:44:16 user nova-compute[74646]:     </enum>
Oct 26 15:44:16 user nova-compute[74646]:     <loader supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>rom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pflash</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='readonly'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>yes</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='secure'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>yes</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </loader>
Oct 26 15:44:16 user nova-compute[74646]:   </os>
Oct 26 15:44:16 user nova-compute[74646]:   <cpu>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-passthrough' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='hostPassthroughMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>on</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='maximum' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='maximumMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>on</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-model' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <vendor>Intel</vendor>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ss'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='vmx'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='pcid'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='hypervisor'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arat'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='umip'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='md-clear'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='invtsc'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibpb'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibrs'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='rsba'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='erms'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='custom' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>qemu64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>qemu32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>phenom</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>n270</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>kvm64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>kvm32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>coreduo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>core2duo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>athlon</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Westmere</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Snowridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Penryn</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G5</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G4</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Opteron_G1</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Nehalem</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Rome</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Milan</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Dhyana</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cooperlake</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Conroe</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>486</model>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:   </cpu>
Oct 26 15:44:16 user nova-compute[74646]:   <memoryBacking supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='sourceType'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>file</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>anonymous</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>memfd</value>
Oct 26 15:44:16 user nova-compute[74646]:     </enum>
Oct 26 15:44:16 user nova-compute[74646]:   </memoryBacking>
Oct 26 15:44:16 user nova-compute[74646]:   <devices>
Oct 26 15:44:16 user nova-compute[74646]:     <disk supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='diskDevice'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>disk</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cdrom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>floppy</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>lun</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='bus'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>fdc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sata</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </disk>
Oct 26 15:44:16 user nova-compute[74646]:     <graphics supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sdl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vnc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>spice</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egl-headless</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </graphics>
Oct 26 15:44:16 user nova-compute[74646]:     <video supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='modelType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cirrus</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vmvga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>qxl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>none</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>bochs</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>ramfb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </video>
Oct 26 15:44:16 user nova-compute[74646]:     <hostdev supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='mode'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>subsystem</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='startupPolicy'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>default</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>mandatory</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>requisite</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>optional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='subsysType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pci</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='capsType'/>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='pciBackend'/>
Oct 26 15:44:16 user nova-compute[74646]:     </hostdev>
Oct 26 15:44:16 user nova-compute[74646]:     <rng supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>random</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egd</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>builtin</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </rng>
Oct 26 15:44:16 user nova-compute[74646]:     <filesystem supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='driverType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>path</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>handle</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtiofs</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </filesystem>
Oct 26 15:44:16 user nova-compute[74646]:     <tpm supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-tis</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-crb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>passthrough</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>emulator</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </tpm>
Oct 26 15:44:16 user nova-compute[74646]:   </devices>
Oct 26 15:44:16 user nova-compute[74646]:   <features>
Oct 26 15:44:16 user nova-compute[74646]:     <gic supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     <vmcoreinfo supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <genid supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backingStoreInput supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backup supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <sev supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:   </features>
Oct 26 15:44:16 user nova-compute[74646]: </domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:  {{(pid=74646) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 26 15:44:16 user nova-compute[74646]: <domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 15:44:16 user nova-compute[74646]:   <domain>kvm</domain>
Oct 26 15:44:16 user nova-compute[74646]:   <machine>pc-i440fx-jammy</machine>
Oct 26 15:44:16 user nova-compute[74646]:   <arch>x86_64</arch>
Oct 26 15:44:16 user nova-compute[74646]:   <vcpu max='255'/>
Oct 26 15:44:16 user nova-compute[74646]:   <iothreads supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:   <os supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='firmware'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>efi</value>
Oct 26 15:44:16 user nova-compute[74646]:     </enum>
Oct 26 15:44:16 user nova-compute[74646]:     <loader supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>rom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pflash</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='readonly'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>yes</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='secure'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </loader>
Oct 26 15:44:16 user nova-compute[74646]:   </os>
Oct 26 15:44:16 user nova-compute[74646]:   <cpu>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-passthrough' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='hostPassthroughMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>on</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='maximum' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='maximumMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>on</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-model' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <vendor>Intel</vendor>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ss'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='vmx'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='pcid'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='hypervisor'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arat'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='umip'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='md-clear'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='invtsc'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibpb'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibrs'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='rsba'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='erms'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='custom' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>qemu64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>qemu32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>phenom</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>n270</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>kvm64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>kvm32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>coreduo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>core2duo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>athlon</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Westmere</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Snowridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Penryn</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G5</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G4</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Opteron_G1</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Nehalem</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Rome</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Milan</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Dhyana</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cooperlake</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Conroe</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>486</model>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:   </cpu>
Oct 26 15:44:16 user nova-compute[74646]:   <memoryBacking supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='sourceType'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>file</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>anonymous</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>memfd</value>
Oct 26 15:44:16 user nova-compute[74646]:     </enum>
Oct 26 15:44:16 user nova-compute[74646]:   </memoryBacking>
Oct 26 15:44:16 user nova-compute[74646]:   <devices>
Oct 26 15:44:16 user nova-compute[74646]:     <disk supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='diskDevice'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>disk</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cdrom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>floppy</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>lun</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='bus'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>ide</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>fdc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sata</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </disk>
Oct 26 15:44:16 user nova-compute[74646]:     <graphics supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sdl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vnc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>spice</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egl-headless</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </graphics>
Oct 26 15:44:16 user nova-compute[74646]:     <video supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='modelType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cirrus</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vmvga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>qxl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>none</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>bochs</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>ramfb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </video>
Oct 26 15:44:16 user nova-compute[74646]:     <hostdev supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='mode'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>subsystem</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='startupPolicy'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>default</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>mandatory</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>requisite</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>optional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='subsysType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pci</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='capsType'/>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='pciBackend'/>
Oct 26 15:44:16 user nova-compute[74646]:     </hostdev>
Oct 26 15:44:16 user nova-compute[74646]:     <rng supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>random</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egd</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>builtin</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </rng>
Oct 26 15:44:16 user nova-compute[74646]:     <filesystem supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='driverType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>path</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>handle</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtiofs</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </filesystem>
Oct 26 15:44:16 user nova-compute[74646]:     <tpm supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-tis</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-crb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>passthrough</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>emulator</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </tpm>
Oct 26 15:44:16 user nova-compute[74646]:   </devices>
Oct 26 15:44:16 user nova-compute[74646]:   <features>
Oct 26 15:44:16 user nova-compute[74646]:     <gic supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     <vmcoreinfo supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <genid supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backingStoreInput supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backup supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <sev supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:   </features>
Oct 26 15:44:16 user nova-compute[74646]: </domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:  {{(pid=74646) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 26 15:44:16 user nova-compute[74646]: <domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 26 15:44:16 user nova-compute[74646]:   <domain>kvm</domain>
Oct 26 15:44:16 user nova-compute[74646]:   <machine>pc-q35-jammy</machine>
Oct 26 15:44:16 user nova-compute[74646]:   <arch>x86_64</arch>
Oct 26 15:44:16 user nova-compute[74646]:   <vcpu max='288'/>
Oct 26 15:44:16 user nova-compute[74646]:   <iothreads supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:   <os supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='firmware'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>efi</value>
Oct 26 15:44:16 user nova-compute[74646]:     </enum>
Oct 26 15:44:16 user nova-compute[74646]:     <loader supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>rom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pflash</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='readonly'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>yes</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='secure'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>yes</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>no</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </loader>
Oct 26 15:44:16 user nova-compute[74646]:   </os>
Oct 26 15:44:16 user nova-compute[74646]:   <cpu>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-passthrough' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='hostPassthroughMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>on</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='maximum' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='maximumMigratable'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>on</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>off</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='host-model' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <vendor>Intel</vendor>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ss'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='vmx'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='pcid'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='hypervisor'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arat'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='tsc_adjust'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='umip'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='md-clear'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='arch-capabilities'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='invtsc'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibpb'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='ibrs'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-stibp'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='amd-ssbd'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='rsba'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='require' name='pschange-mc-no'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='erms'/>
Oct 26 15:44:16 user nova-compute[74646]:       <feature policy='disable' name='xsaveopt'/>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:     <mode name='custom' supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>qemu64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>qemu32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>phenom</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>pentium</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>n270</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>kvm64</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>kvm32</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>coreduo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>core2duo</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>athlon</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Westmere-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Westmere</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Snowridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Skylake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>SandyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Penryn</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G5</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G4</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G3</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Opteron_G2</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Opteron_G1</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Nehalem</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>IvyBridge</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Icelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Haswell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Rome</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-Milan</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC-IBPB</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>EPYC</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Dhyana</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cooperlake</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>Conroe</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Cascadelake-Server</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-noTSX</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell-IBRS</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='no'>Broadwell</model>
Oct 26 15:44:16 user nova-compute[74646]:       <model usable='yes'>486</model>
Oct 26 15:44:16 user nova-compute[74646]:     </mode>
Oct 26 15:44:16 user nova-compute[74646]:   </cpu>
Oct 26 15:44:16 user nova-compute[74646]:   <memoryBacking supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:     <enum name='sourceType'>
Oct 26 15:44:16 user nova-compute[74646]:       <value>file</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>anonymous</value>
Oct 26 15:44:16 user nova-compute[74646]:       <value>memfd</value>
Oct 26 15:44:16 user nova-compute[74646]:     </enum>
Oct 26 15:44:16 user nova-compute[74646]:   </memoryBacking>
Oct 26 15:44:16 user nova-compute[74646]:   <devices>
Oct 26 15:44:16 user nova-compute[74646]:     <disk supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='diskDevice'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>disk</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cdrom</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>floppy</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>lun</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='bus'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>fdc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sata</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </disk>
Oct 26 15:44:16 user nova-compute[74646]:     <graphics supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='type'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>sdl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vnc</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>spice</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egl-headless</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </graphics>
Oct 26 15:44:16 user nova-compute[74646]:     <video supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='modelType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>cirrus</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>vmvga</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>qxl</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>none</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>bochs</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>ramfb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </video>
Oct 26 15:44:16 user nova-compute[74646]:     <hostdev supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='mode'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>subsystem</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='startupPolicy'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>default</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>mandatory</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>requisite</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>optional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='subsysType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>usb</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>pci</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>scsi</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='capsType'/>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='pciBackend'/>
Oct 26 15:44:16 user nova-compute[74646]:     </hostdev>
Oct 26 15:44:16 user nova-compute[74646]:     <rng supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtio-non-transitional</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>random</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>egd</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>builtin</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </rng>
Oct 26 15:44:16 user nova-compute[74646]:     <filesystem supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='driverType'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>path</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>handle</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>virtiofs</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </filesystem>
Oct 26 15:44:16 user nova-compute[74646]:     <tpm supported='yes'>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='model'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-tis</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>tpm-crb</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:       <enum name='backendModel'>
Oct 26 15:44:16 user nova-compute[74646]:         <value>passthrough</value>
Oct 26 15:44:16 user nova-compute[74646]:         <value>emulator</value>
Oct 26 15:44:16 user nova-compute[74646]:       </enum>
Oct 26 15:44:16 user nova-compute[74646]:     </tpm>
Oct 26 15:44:16 user nova-compute[74646]:   </devices>
Oct 26 15:44:16 user nova-compute[74646]:   <features>
Oct 26 15:44:16 user nova-compute[74646]:     <gic supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:     <vmcoreinfo supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <genid supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backingStoreInput supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <backup supported='yes'/>
Oct 26 15:44:16 user nova-compute[74646]:     <sev supported='no'/>
Oct 26 15:44:16 user nova-compute[74646]:   </features>
Oct 26 15:44:16 user nova-compute[74646]: </domainCapabilities>
Oct 26 15:44:16 user nova-compute[74646]:  {{(pid=74646) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74646) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74646) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Checking secure boot support for host arch (x86_64) {{(pid=74646) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Checking secure boot support for host arch (x86_64) {{(pid=74646) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Checking secure boot support for host arch (x86_64) {{(pid=74646) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 26 15:44:16 user nova-compute[74646]: INFO nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Secure Boot support detected
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] cpu compare xml: <cpu match="exact">
Oct 26 15:44:16 user nova-compute[74646]:   <model>Nehalem</model>
Oct 26 15:44:16 user nova-compute[74646]: </cpu>
Oct 26 15:44:16 user nova-compute[74646]:  {{(pid=74646) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 26 15:44:16 user nova-compute[74646]: INFO nova.virt.node [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Generated node identity 88f94598-b16e-4979-b37d-cf11430ad3e6
Oct 26 15:44:16 user nova-compute[74646]: INFO nova.virt.node [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Wrote node identity 88f94598-b16e-4979-b37d-cf11430ad3e6 to /opt/stack/data/nova/compute_id
Oct 26 15:44:16 user nova-compute[74646]: WARNING nova.compute.manager [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Compute nodes ['88f94598-b16e-4979-b37d-cf11430ad3e6'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 26 15:44:16 user nova-compute[74646]: INFO nova.compute.manager [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 26 15:44:16 user nova-compute[74646]: WARNING nova.compute.manager [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 26 15:44:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:44:16 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:44:16 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Hypervisor/Node resource view: name=user free_ram=11006MB free_disk=26.266643524169922GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:44:16 user nova-compute[74646]: WARNING nova.compute.resource_tracker [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] No compute node record for user:88f94598-b16e-4979-b37d-cf11430ad3e6: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 88f94598-b16e-4979-b37d-cf11430ad3e6 could not be found.
Oct 26 15:44:16 user nova-compute[74646]: INFO nova.compute.resource_tracker [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Compute node record created for user:user with uuid: 88f94598-b16e-4979-b37d-cf11430ad3e6
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:44:16 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:44:17 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] [req-edf09b26-af66-4625-9eac-824f13903f1c] Created resource provider record via placement API for resource provider with UUID 88f94598-b16e-4979-b37d-cf11430ad3e6 and name user.
Oct 26 15:44:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74646) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 26 15:44:17 user nova-compute[74646]: INFO nova.virt.libvirt.host [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] kernel doesn't support AMD SEV
Oct 26 15:44:17 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Updating inventory in ProviderTree for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 15:44:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:44:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Libvirt baseline CPU <cpu>
Oct 26 15:44:17 user nova-compute[74646]:   <arch>x86_64</arch>
Oct 26 15:44:17 user nova-compute[74646]:   <model>Nehalem</model>
Oct 26 15:44:17 user nova-compute[74646]:   <vendor>Intel</vendor>
Oct 26 15:44:17 user nova-compute[74646]:   <topology sockets="6" cores="1" threads="1"/>
Oct 26 15:44:17 user nova-compute[74646]: </cpu>
Oct 26 15:44:17 user nova-compute[74646]:  {{(pid=74646) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 26 15:44:17 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Updated inventory for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 26 15:44:17 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Updating resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6 generation from 0 to 1 during operation: update_inventory {{(pid=74646) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 26 15:44:17 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Updating inventory in ProviderTree for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 15:44:17 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Updating resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6 generation from 1 to 2 during operation: update_traits {{(pid=74646) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 26 15:44:17 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:44:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.638s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:44:17 user nova-compute[74646]: DEBUG nova.service [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Creating RPC server for service compute {{(pid=74646) start /opt/stack/nova/nova/service.py:182}}
Oct 26 15:44:17 user nova-compute[74646]: DEBUG nova.service [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] Join ServiceGroup membership for this service compute {{(pid=74646) start /opt/stack/nova/nova/service.py:199}}
Oct 26 15:44:17 user nova-compute[74646]: DEBUG nova.servicegroup.drivers.db [None req-9a106afa-acd0-41ea-ba05-3061ce241f00 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74646) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Rebuilding the list of instances to heal {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Didn't find any instances for network info cache update. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_power_states {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:45:11 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:45:11 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:45:11 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=10405MB free_disk=26.1702880859375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.165s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:45:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:46:08 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:46:08 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:46:08 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:46:08 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Rebuilding the list of instances to heal {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 15:46:08 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Didn't find any instances for network info cache update. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 15:46:08 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:46:08 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:46:08 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:46:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:46:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:46:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:46:08 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:46:09 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:46:09 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:46:09 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=10342MB free_disk=26.23434066772461GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:46:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:46:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:46:09 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:46:09 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:46:09 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:46:09 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:46:09 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:46:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.152s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:46:09 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:46:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:46:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:46:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:46:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:46:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:47:08 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:47:08 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:47:09 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:47:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:47:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Rebuilding the list of instances to heal {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 15:47:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Didn't find any instances for network info cache update. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 15:47:09 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:47:10 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:47:10 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:47:10 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=10376MB free_disk=25.98800277709961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:47:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:08 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:48:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:48:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:48:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:48:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:48:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:48:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:48:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:48:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:48:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:48:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Rebuilding the list of instances to heal {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 15:48:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Didn't find any instances for network info cache update. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 15:48:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:48:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:11 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:48:11 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:48:11 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:48:11 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=9615MB free_disk=26.007503509521484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:48:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:11 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:48:11 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:48:12 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:48:12 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:48:12 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:48:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.173s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:13 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:48:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "1c5d5313-72f0-4f49-83b7-f277d5da4191" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:18 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:48:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:18 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:48:18 user nova-compute[74646]: INFO nova.compute.claims [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Claim successful on node user
Oct 26 15:48:18 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:48:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.261s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:48:19 user nova-compute[74646]: INFO nova.compute.claims [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Claim successful on node user
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:48:19 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:48:19 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Creating image(s)
Oct 26 15:48:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "/opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "/opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.network.neutron [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:48:19 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:48:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7.part --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG nova.policy [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c53fa7260a54cee97a07bc12f78144e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9743ac2f5304819835c4f369c376e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG nova.policy [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18f080f51ac04c23a489e5dc115a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5888676639c54df88e50f01bf81d3cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquiring lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG nova.virt.images [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] 82af3b5f-8d68-4fc0-b4be-1ea2303721ff was qcow2, converting to raw {{(pid=74646) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG nova.privsep.utils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74646) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7.part /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7.converted {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG nova.compute.manager [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:48:20 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Creating image(s)
Oct 26 15:48:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "/opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "/opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "/opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7.part /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7.converted" returned: 0 in 0.316s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7.converted --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:20 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:48:20 user nova-compute[74646]: INFO nova.compute.claims [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Claim successful on node user
Oct 26 15:48:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.383s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:21 user nova-compute[74646]: INFO oslo.privsep.daemon [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpz81dmtla/privsep.sock']
Oct 26 15:48:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.365s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:21 user sudo[83903]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpz81dmtla/privsep.sock
Oct 26 15:48:21 user sudo[83903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 15:48:21 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:48:21 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:48:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:48:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:48:21 user nova-compute[74646]: DEBUG nova.network.neutron [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:48:21 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:48:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:48:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:48:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:48:21 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Creating image(s)
Oct 26 15:48:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquiring lock "/opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "/opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "/opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:21 user nova-compute[74646]: DEBUG nova.policy [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '243594cee6354d3c9b908d2d51d07186', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f56a4ff471842b08578b281d4c7f6ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:48:22 user sudo[83903]: pam_unix(sudo:session): session closed for user root
Oct 26 15:48:22 user nova-compute[74646]: INFO oslo.privsep.daemon [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Spawned new privsep daemon via rootwrap
Oct 26 15:48:22 user nova-compute[74646]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 15:48:22 user nova-compute[74646]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 15:48:22 user nova-compute[74646]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 26 15:48:22 user nova-compute[74646]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83907
Oct 26 15:48:22 user nova-compute[74646]: WARNING oslo_privsep.priv_context [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] privsep daemon already running
Oct 26 15:48:22 user nova-compute[74646]: WARNING oslo_privsep.priv_context [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] privsep daemon already running
Oct 26 15:48:22 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Successfully created port: 529d94bf-3278-41ad-b2c1-522b68db2421 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:48:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.173s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.196s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.231s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.231s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk 1073741824" returned: 0 in 0.048s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.234s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.158s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.250s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk 1073741824" returned: 0 in 0.050s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.307s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.567s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Cannot resize image /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Ensure instance console log exists: /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.004s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG nova.network.neutron [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Successfully created port: e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.176s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Checking if we can resize image /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.181s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk 1073741824" returned: 0 in 0.049s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Cannot resize image /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Ensure instance console log exists: /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.204s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:48:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:24 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Cannot resize image /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:48:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:48:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Ensure instance console log exists: /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:48:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:24 user nova-compute[74646]: DEBUG nova.network.neutron [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Successfully created port: abbdb247-c34c-4e34-a214-4752c749a42a {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:48:24 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Successfully updated port: 529d94bf-3278-41ad-b2c1-522b68db2421 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:48:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:48:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquired lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:48:25 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:48:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-abb33776-eff9-48d1-95de-02a8e17a9084 req-fafdd02f-4359-48f0-b241-914c54d78b8a service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Received event network-changed-529d94bf-3278-41ad-b2c1-522b68db2421 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-abb33776-eff9-48d1-95de-02a8e17a9084 req-fafdd02f-4359-48f0-b241-914c54d78b8a service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Refreshing instance network info cache due to event network-changed-529d94bf-3278-41ad-b2c1-522b68db2421. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:48:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-abb33776-eff9-48d1-95de-02a8e17a9084 req-fafdd02f-4359-48f0-b241-914c54d78b8a service nova] Acquiring lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:48:25 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Updating instance_info_cache with network_info: [{"id": "529d94bf-3278-41ad-b2c1-522b68db2421", "address": "fa:16:3e:2e:e2:50", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529d94bf-32", "ovs_interfaceid": "529d94bf-3278-41ad-b2c1-522b68db2421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Releasing lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Instance network_info: |[{"id": "529d94bf-3278-41ad-b2c1-522b68db2421", "address": "fa:16:3e:2e:e2:50", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529d94bf-32", "ovs_interfaceid": "529d94bf-3278-41ad-b2c1-522b68db2421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-abb33776-eff9-48d1-95de-02a8e17a9084 req-fafdd02f-4359-48f0-b241-914c54d78b8a service nova] Acquired lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.network.neutron [req-abb33776-eff9-48d1-95de-02a8e17a9084 req-fafdd02f-4359-48f0-b241-914c54d78b8a service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Refreshing network info cache for port 529d94bf-3278-41ad-b2c1-522b68db2421 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Start _get_guest_xml network_info=[{"id": "529d94bf-3278-41ad-b2c1-522b68db2421", "address": "fa:16:3e:2e:e2:50", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529d94bf-32", "ovs_interfaceid": "529d94bf-3278-41ad-b2c1-522b68db2421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:48:26 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:48:26 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.privsep.utils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74646) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1376727781',display_name='tempest-ServersNegativeTestJSON-server-1376727781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1376727781',id=1,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9743ac2f5304819835c4f369c376e31',ramdisk_id='',reservation_id='r-tkjx807k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-986135927',owner_user_name='tempest-ServersNegativeTestJSON-986135927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:48:20Z,user_data=None,user_id='9c53fa7260a54cee97a07bc12f78144e',uuid=1c5d5313-72f0-4f49-83b7-f277d5da4191,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "529d94bf-3278-41ad-b2c1-522b68db2421", "address": "fa:16:3e:2e:e2:50", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529d94bf-32", "ovs_interfaceid": "529d94bf-3278-41ad-b2c1-522b68db2421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Converting VIF {"id": "529d94bf-3278-41ad-b2c1-522b68db2421", "address": "fa:16:3e:2e:e2:50", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529d94bf-32", "ovs_interfaceid": "529d94bf-3278-41ad-b2c1-522b68db2421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e2:50,bridge_name='br-int',has_traffic_filtering=True,id=529d94bf-3278-41ad-b2c1-522b68db2421,network=Network(553f3b75-4be8-40fa-a771-51ae8487bd58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529d94bf-32') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.objects.instance [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c5d5313-72f0-4f49-83b7-f277d5da4191 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.network.neutron [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Successfully updated port: e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:48:26 user nova-compute[74646]:   <uuid>1c5d5313-72f0-4f49-83b7-f277d5da4191</uuid>
Oct 26 15:48:26 user nova-compute[74646]:   <name>instance-00000001</name>
Oct 26 15:48:26 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:48:26 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:48:26 user nova-compute[74646]:   <metadata>
Oct 26 15:48:26 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:48:26 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:48:26 user nova-compute[74646]:       <nova:name>tempest-ServersNegativeTestJSON-server-1376727781</nova:name>
Oct 26 15:48:26 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:48:26</nova:creationTime>
Oct 26 15:48:26 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:48:26 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:48:26 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:48:26 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:48:26 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:48:26 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:48:26 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:48:26 user nova-compute[74646]:       <nova:owner>
Oct 26 15:48:26 user nova-compute[74646]:         <nova:user uuid="9c53fa7260a54cee97a07bc12f78144e">tempest-ServersNegativeTestJSON-986135927-project-member</nova:user>
Oct 26 15:48:26 user nova-compute[74646]:         <nova:project uuid="e9743ac2f5304819835c4f369c376e31">tempest-ServersNegativeTestJSON-986135927</nova:project>
Oct 26 15:48:26 user nova-compute[74646]:       </nova:owner>
Oct 26 15:48:26 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:48:26 user nova-compute[74646]:       <nova:ports>
Oct 26 15:48:26 user nova-compute[74646]:         <nova:port uuid="529d94bf-3278-41ad-b2c1-522b68db2421">
Oct 26 15:48:26 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 15:48:26 user nova-compute[74646]:         </nova:port>
Oct 26 15:48:26 user nova-compute[74646]:       </nova:ports>
Oct 26 15:48:26 user nova-compute[74646]:     </nova:instance>
Oct 26 15:48:26 user nova-compute[74646]:   </metadata>
Oct 26 15:48:26 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:48:26 user nova-compute[74646]:     <system>
Oct 26 15:48:26 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:48:26 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:48:26 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:48:26 user nova-compute[74646]:       <entry name="serial">1c5d5313-72f0-4f49-83b7-f277d5da4191</entry>
Oct 26 15:48:26 user nova-compute[74646]:       <entry name="uuid">1c5d5313-72f0-4f49-83b7-f277d5da4191</entry>
Oct 26 15:48:26 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:48:26 user nova-compute[74646]:     </system>
Oct 26 15:48:26 user nova-compute[74646]:   </sysinfo>
Oct 26 15:48:26 user nova-compute[74646]:   <os>
Oct 26 15:48:26 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:48:26 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:48:26 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:48:26 user nova-compute[74646]:   </os>
Oct 26 15:48:26 user nova-compute[74646]:   <features>
Oct 26 15:48:26 user nova-compute[74646]:     <acpi/>
Oct 26 15:48:26 user nova-compute[74646]:     <apic/>
Oct 26 15:48:26 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:48:26 user nova-compute[74646]:   </features>
Oct 26 15:48:26 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:48:26 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:48:26 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:48:26 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:48:26 user nova-compute[74646]:   </clock>
Oct 26 15:48:26 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:48:26 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:48:26 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:48:26 user nova-compute[74646]:   </cpu>
Oct 26 15:48:26 user nova-compute[74646]:   <devices>
Oct 26 15:48:26 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:48:26 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:48:26 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk"/>
Oct 26 15:48:26 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:48:26 user nova-compute[74646]:     </disk>
Oct 26 15:48:26 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:48:26 user nova-compute[74646]:       <mac address="fa:16:3e:2e:e2:50"/>
Oct 26 15:48:26 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:48:26 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:48:26 user nova-compute[74646]:       <target dev="tap529d94bf-32"/>
Oct 26 15:48:26 user nova-compute[74646]:     </interface>
Oct 26 15:48:26 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:48:26 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/console.log" append="off"/>
Oct 26 15:48:26 user nova-compute[74646]:     </serial>
Oct 26 15:48:26 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:48:26 user nova-compute[74646]:     <video>
Oct 26 15:48:26 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:48:26 user nova-compute[74646]:     </video>
Oct 26 15:48:26 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:48:26 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:48:26 user nova-compute[74646]:     </rng>
Oct 26 15:48:26 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:48:26 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:48:26 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:48:26 user nova-compute[74646]:     </memballoon>
Oct 26 15:48:26 user nova-compute[74646]:   </devices>
Oct 26 15:48:26 user nova-compute[74646]: </domain>
Oct 26 15:48:26 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1376727781',display_name='tempest-ServersNegativeTestJSON-server-1376727781',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1376727781',id=1,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9743ac2f5304819835c4f369c376e31',ramdisk_id='',reservation_id='r-tkjx807k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-986135927',owner_user_name='tempest-ServersNegativeTestJSON-986135927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:48:20Z,user_data=None,user_id='9c53fa7260a54cee97a07bc12f78144e',uuid=1c5d5313-72f0-4f49-83b7-f277d5da4191,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "529d94bf-3278-41ad-b2c1-522b68db2421", "address": "fa:16:3e:2e:e2:50", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529d94bf-32", "ovs_interfaceid": "529d94bf-3278-41ad-b2c1-522b68db2421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Converting VIF {"id": "529d94bf-3278-41ad-b2c1-522b68db2421", "address": "fa:16:3e:2e:e2:50", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529d94bf-32", "ovs_interfaceid": "529d94bf-3278-41ad-b2c1-522b68db2421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e2:50,bridge_name='br-int',has_traffic_filtering=True,id=529d94bf-3278-41ad-b2c1-522b68db2421,network=Network(553f3b75-4be8-40fa-a771-51ae8487bd58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529d94bf-32') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG os_vif [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e2:50,bridge_name='br-int',has_traffic_filtering=True,id=529d94bf-3278-41ad-b2c1-522b68db2421,network=Network(553f3b75-4be8-40fa-a771-51ae8487bd58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529d94bf-32') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Created schema index Interface.name {{(pid=74646) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Created schema index Port.name {{(pid=74646) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Created schema index Bridge.name {{(pid=74646) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [POLLOUT] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "refresh_cache-5e42f38e-e10f-43b7-89ab-ab22addfcf95" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquired lock "refresh_cache-5e42f38e-e10f-43b7-89ab-ab22addfcf95" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.network.neutron [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce7fde02-ae7a-5e65-a5b6-9a08a3b59752', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:48:26 user nova-compute[74646]: INFO oslo.privsep.daemon [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpuhzhh4g6/privsep.sock']
Oct 26 15:48:26 user sudo[83959]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpuhzhh4g6/privsep.sock
Oct 26 15:48:26 user sudo[83959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-7d1f0a9c-0efe-4540-a8bd-4cfe96bd851c req-4a34f47e-f24c-4a88-a861-42d3f01e9421 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Received event network-changed-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-7d1f0a9c-0efe-4540-a8bd-4cfe96bd851c req-4a34f47e-f24c-4a88-a861-42d3f01e9421 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Refreshing instance network info cache due to event network-changed-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:48:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7d1f0a9c-0efe-4540-a8bd-4cfe96bd851c req-4a34f47e-f24c-4a88-a861-42d3f01e9421 service nova] Acquiring lock "refresh_cache-5e42f38e-e10f-43b7-89ab-ab22addfcf95" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:48:27 user nova-compute[74646]: DEBUG nova.network.neutron [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:48:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:27 user nova-compute[74646]: DEBUG nova.network.neutron [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Successfully updated port: abbdb247-c34c-4e34-a214-4752c749a42a {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:48:27 user nova-compute[74646]: DEBUG nova.network.neutron [req-abb33776-eff9-48d1-95de-02a8e17a9084 req-fafdd02f-4359-48f0-b241-914c54d78b8a service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Updated VIF entry in instance network info cache for port 529d94bf-3278-41ad-b2c1-522b68db2421. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:48:27 user nova-compute[74646]: DEBUG nova.network.neutron [req-abb33776-eff9-48d1-95de-02a8e17a9084 req-fafdd02f-4359-48f0-b241-914c54d78b8a service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Updating instance_info_cache with network_info: [{"id": "529d94bf-3278-41ad-b2c1-522b68db2421", "address": "fa:16:3e:2e:e2:50", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529d94bf-32", "ovs_interfaceid": "529d94bf-3278-41ad-b2c1-522b68db2421", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:48:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquiring lock "refresh_cache-042a78ac-e95b-45ae-8a9f-9fc0be22881c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:48:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquired lock "refresh_cache-042a78ac-e95b-45ae-8a9f-9fc0be22881c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:48:27 user nova-compute[74646]: DEBUG nova.network.neutron [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:48:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-abb33776-eff9-48d1-95de-02a8e17a9084 req-fafdd02f-4359-48f0-b241-914c54d78b8a service nova] Releasing lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:48:27 user nova-compute[74646]: DEBUG nova.network.neutron [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.network.neutron [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Updating instance_info_cache with network_info: [{"id": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "address": "fa:16:3e:81:8c:c3", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59d9ca3-b8", "ovs_interfaceid": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Releasing lock "refresh_cache-5e42f38e-e10f-43b7-89ab-ab22addfcf95" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Instance network_info: |[{"id": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "address": "fa:16:3e:81:8c:c3", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59d9ca3-b8", "ovs_interfaceid": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7d1f0a9c-0efe-4540-a8bd-4cfe96bd851c req-4a34f47e-f24c-4a88-a861-42d3f01e9421 service nova] Acquired lock "refresh_cache-5e42f38e-e10f-43b7-89ab-ab22addfcf95" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.network.neutron [req-7d1f0a9c-0efe-4540-a8bd-4cfe96bd851c req-4a34f47e-f24c-4a88-a861-42d3f01e9421 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Refreshing network info cache for port e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Start _get_guest_xml network_info=[{"id": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "address": "fa:16:3e:81:8c:c3", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59d9ca3-b8", "ovs_interfaceid": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:48:28 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:48:28 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:48:28 user sudo[83959]: pam_unix(sudo:session): session closed for user root
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1043468833',display_name='tempest-AttachVolumeTestJSON-server-1043468833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1043468833',id=2,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHn8rm45Kj9Re6BL30H2w6DxBxC/ij4uFpyMPHadSUiWneGNBRJdFMtPDT/ID3tOj17UNmJkBabHKoH4/5yows/aVTjy9mo3JiVH8WBYMuekLmGfJxRFUWT2mM0nAS6kTw==',key_name='tempest-keypair-836871958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5888676639c54df88e50f01bf81d3cb8',ramdisk_id='',reservation_id='r-k9gjc6pl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1526735619',owner_user_name='tempest-AttachVolumeTestJSON-1526735619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:48:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f080f51ac04c23a489e5dc115a1ba1',uuid=5e42f38e-e10f-43b7-89ab-ab22addfcf95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "address": "fa:16:3e:81:8c:c3", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59d9ca3-b8", "ovs_interfaceid": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Converting VIF {"id": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "address": "fa:16:3e:81:8c:c3", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59d9ca3-b8", "ovs_interfaceid": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:8c:c3,bridge_name='br-int',has_traffic_filtering=True,id=e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc,network=Network(4a154aa2-0773-459f-b145-b76412506085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59d9ca3-b8') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.objects.instance [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e42f38e-e10f-43b7-89ab-ab22addfcf95 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:48:28 user nova-compute[74646]: INFO oslo.privsep.daemon [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Spawned new privsep daemon via rootwrap
Oct 26 15:48:28 user nova-compute[74646]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 15:48:28 user nova-compute[74646]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 15:48:28 user nova-compute[74646]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 26 15:48:28 user nova-compute[74646]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83964
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:48:28 user nova-compute[74646]:   <uuid>5e42f38e-e10f-43b7-89ab-ab22addfcf95</uuid>
Oct 26 15:48:28 user nova-compute[74646]:   <name>instance-00000002</name>
Oct 26 15:48:28 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:48:28 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:48:28 user nova-compute[74646]:   <metadata>
Oct 26 15:48:28 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:48:28 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:48:28 user nova-compute[74646]:       <nova:name>tempest-AttachVolumeTestJSON-server-1043468833</nova:name>
Oct 26 15:48:28 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:48:28</nova:creationTime>
Oct 26 15:48:28 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:48:28 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:48:28 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:48:28 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:48:28 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:48:28 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:48:28 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:48:28 user nova-compute[74646]:       <nova:owner>
Oct 26 15:48:28 user nova-compute[74646]:         <nova:user uuid="18f080f51ac04c23a489e5dc115a1ba1">tempest-AttachVolumeTestJSON-1526735619-project-member</nova:user>
Oct 26 15:48:28 user nova-compute[74646]:         <nova:project uuid="5888676639c54df88e50f01bf81d3cb8">tempest-AttachVolumeTestJSON-1526735619</nova:project>
Oct 26 15:48:28 user nova-compute[74646]:       </nova:owner>
Oct 26 15:48:28 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:48:28 user nova-compute[74646]:       <nova:ports>
Oct 26 15:48:28 user nova-compute[74646]:         <nova:port uuid="e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc">
Oct 26 15:48:28 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 15:48:28 user nova-compute[74646]:         </nova:port>
Oct 26 15:48:28 user nova-compute[74646]:       </nova:ports>
Oct 26 15:48:28 user nova-compute[74646]:     </nova:instance>
Oct 26 15:48:28 user nova-compute[74646]:   </metadata>
Oct 26 15:48:28 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:48:28 user nova-compute[74646]:     <system>
Oct 26 15:48:28 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:48:28 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:48:28 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:48:28 user nova-compute[74646]:       <entry name="serial">5e42f38e-e10f-43b7-89ab-ab22addfcf95</entry>
Oct 26 15:48:28 user nova-compute[74646]:       <entry name="uuid">5e42f38e-e10f-43b7-89ab-ab22addfcf95</entry>
Oct 26 15:48:28 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:48:28 user nova-compute[74646]:     </system>
Oct 26 15:48:28 user nova-compute[74646]:   </sysinfo>
Oct 26 15:48:28 user nova-compute[74646]:   <os>
Oct 26 15:48:28 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:48:28 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:48:28 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:48:28 user nova-compute[74646]:   </os>
Oct 26 15:48:28 user nova-compute[74646]:   <features>
Oct 26 15:48:28 user nova-compute[74646]:     <acpi/>
Oct 26 15:48:28 user nova-compute[74646]:     <apic/>
Oct 26 15:48:28 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:48:28 user nova-compute[74646]:   </features>
Oct 26 15:48:28 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:48:28 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:48:28 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:48:28 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:48:28 user nova-compute[74646]:   </clock>
Oct 26 15:48:28 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:48:28 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:48:28 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:48:28 user nova-compute[74646]:   </cpu>
Oct 26 15:48:28 user nova-compute[74646]:   <devices>
Oct 26 15:48:28 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:48:28 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:48:28 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk"/>
Oct 26 15:48:28 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:48:28 user nova-compute[74646]:     </disk>
Oct 26 15:48:28 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:48:28 user nova-compute[74646]:       <mac address="fa:16:3e:81:8c:c3"/>
Oct 26 15:48:28 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:48:28 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:48:28 user nova-compute[74646]:       <target dev="tape59d9ca3-b8"/>
Oct 26 15:48:28 user nova-compute[74646]:     </interface>
Oct 26 15:48:28 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:48:28 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/console.log" append="off"/>
Oct 26 15:48:28 user nova-compute[74646]:     </serial>
Oct 26 15:48:28 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:48:28 user nova-compute[74646]:     <video>
Oct 26 15:48:28 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:48:28 user nova-compute[74646]:     </video>
Oct 26 15:48:28 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:48:28 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:48:28 user nova-compute[74646]:     </rng>
Oct 26 15:48:28 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:48:28 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:48:28 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:48:28 user nova-compute[74646]:     </memballoon>
Oct 26 15:48:28 user nova-compute[74646]:   </devices>
Oct 26 15:48:28 user nova-compute[74646]: </domain>
Oct 26 15:48:28 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1043468833',display_name='tempest-AttachVolumeTestJSON-server-1043468833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1043468833',id=2,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHn8rm45Kj9Re6BL30H2w6DxBxC/ij4uFpyMPHadSUiWneGNBRJdFMtPDT/ID3tOj17UNmJkBabHKoH4/5yows/aVTjy9mo3JiVH8WBYMuekLmGfJxRFUWT2mM0nAS6kTw==',key_name='tempest-keypair-836871958',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5888676639c54df88e50f01bf81d3cb8',ramdisk_id='',reservation_id='r-k9gjc6pl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1526735619',owner_user_name='tempest-AttachVolumeTestJSON-1526735619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:48:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f080f51ac04c23a489e5dc115a1ba1',uuid=5e42f38e-e10f-43b7-89ab-ab22addfcf95,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "address": "fa:16:3e:81:8c:c3", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59d9ca3-b8", "ovs_interfaceid": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Converting VIF {"id": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "address": "fa:16:3e:81:8c:c3", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59d9ca3-b8", "ovs_interfaceid": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:8c:c3,bridge_name='br-int',has_traffic_filtering=True,id=e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc,network=Network(4a154aa2-0773-459f-b145-b76412506085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59d9ca3-b8') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG os_vif [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:8c:c3,bridge_name='br-int',has_traffic_filtering=True,id=e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc,network=Network(4a154aa2-0773-459f-b145-b76412506085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59d9ca3-b8') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4791c0e6-1aaf-572e-a1a4-1dd28a6ffff7', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:48:28 user nova-compute[74646]: WARNING oslo_privsep.priv_context [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] privsep daemon already running
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.network.neutron [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Updating instance_info_cache with network_info: [{"id": "abbdb247-c34c-4e34-a214-4752c749a42a", "address": "fa:16:3e:4d:1f:9f", "network": {"id": "206b243c-9e14-4604-8007-2184c3ab67d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1553675839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f56a4ff471842b08578b281d4c7f6ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbdb247-c3", "ovs_interfaceid": "abbdb247-c34c-4e34-a214-4752c749a42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Releasing lock "refresh_cache-042a78ac-e95b-45ae-8a9f-9fc0be22881c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.compute.manager [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Instance network_info: |[{"id": "abbdb247-c34c-4e34-a214-4752c749a42a", "address": "fa:16:3e:4d:1f:9f", "network": {"id": "206b243c-9e14-4604-8007-2184c3ab67d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1553675839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f56a4ff471842b08578b281d4c7f6ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbdb247-c3", "ovs_interfaceid": "abbdb247-c34c-4e34-a214-4752c749a42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Start _get_guest_xml network_info=[{"id": "abbdb247-c34c-4e34-a214-4752c749a42a", "address": "fa:16:3e:4d:1f:9f", "network": {"id": "206b243c-9e14-4604-8007-2184c3ab67d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1553675839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f56a4ff471842b08578b281d4c7f6ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbdb247-c3", "ovs_interfaceid": "abbdb247-c34c-4e34-a214-4752c749a42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape59d9ca3-b8, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape59d9ca3-b8, col_values=(('qos', UUID('071765d6-bc0b-4e31-8b97-c8f8a7d25bd4')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape59d9ca3-b8, col_values=(('external_ids', {'iface-id': 'e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:8c:c3', 'vm-uuid': '5e42f38e-e10f-43b7-89ab-ab22addfcf95'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:28 user nova-compute[74646]: INFO os_vif [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:8c:c3,bridge_name='br-int',has_traffic_filtering=True,id=e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc,network=Network(4a154aa2-0773-459f-b145-b76412506085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59d9ca3-b8')
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap529d94bf-32, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap529d94bf-32, col_values=(('qos', UUID('7945997a-2f33-486b-9a3d-a533fa38b0d4')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap529d94bf-32, col_values=(('external_ids', {'iface-id': '529d94bf-3278-41ad-b2c1-522b68db2421', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:e2:50', 'vm-uuid': '1c5d5313-72f0-4f49-83b7-f277d5da4191'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:48:28 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:48:28 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:48:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-168873447',display_name='tempest-DeleteServersTestJSON-server-168873447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-168873447',id=3,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f56a4ff471842b08578b281d4c7f6ab',ramdisk_id='',reservation_id='r-qiz3f51v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1914251399',owner_user_name='tempest-DeleteServersTestJSON-1914251399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:48:21Z,user_data=None,user_id='243594cee6354d3c9b908d2d51d07186',uuid=042a78ac-e95b-45ae-8a9f-9fc0be22881c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abbdb247-c34c-4e34-a214-4752c749a42a", "address": "fa:16:3e:4d:1f:9f", "network": {"id": "206b243c-9e14-4604-8007-2184c3ab67d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1553675839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f56a4ff471842b08578b281d4c7f6ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbdb247-c3", "ovs_interfaceid": "abbdb247-c34c-4e34-a214-4752c749a42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Converting VIF {"id": "abbdb247-c34c-4e34-a214-4752c749a42a", "address": "fa:16:3e:4d:1f:9f", "network": {"id": "206b243c-9e14-4604-8007-2184c3ab67d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1553675839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f56a4ff471842b08578b281d4c7f6ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbdb247-c3", "ovs_interfaceid": "abbdb247-c34c-4e34-a214-4752c749a42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:1f:9f,bridge_name='br-int',has_traffic_filtering=True,id=abbdb247-c34c-4e34-a214-4752c749a42a,network=Network(206b243c-9e14-4604-8007-2184c3ab67d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbdb247-c3') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.objects.instance [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lazy-loading 'pci_devices' on Instance uuid 042a78ac-e95b-45ae-8a9f-9fc0be22881c {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:28 user nova-compute[74646]: INFO os_vif [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:e2:50,bridge_name='br-int',has_traffic_filtering=True,id=529d94bf-3278-41ad-b2c1-522b68db2421,network=Network(553f3b75-4be8-40fa-a771-51ae8487bd58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529d94bf-32')
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.compute.manager [req-47150700-db92-49f7-8818-744a7864d573 req-dcbc9337-0b8a-4e9a-84d0-b75900a3c745 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Received event network-changed-abbdb247-c34c-4e34-a214-4752c749a42a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.compute.manager [req-47150700-db92-49f7-8818-744a7864d573 req-dcbc9337-0b8a-4e9a-84d0-b75900a3c745 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Refreshing instance network info cache due to event network-changed-abbdb247-c34c-4e34-a214-4752c749a42a. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-47150700-db92-49f7-8818-744a7864d573 req-dcbc9337-0b8a-4e9a-84d0-b75900a3c745 service nova] Acquiring lock "refresh_cache-042a78ac-e95b-45ae-8a9f-9fc0be22881c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-47150700-db92-49f7-8818-744a7864d573 req-dcbc9337-0b8a-4e9a-84d0-b75900a3c745 service nova] Acquired lock "refresh_cache-042a78ac-e95b-45ae-8a9f-9fc0be22881c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:48:28 user nova-compute[74646]: DEBUG nova.network.neutron [req-47150700-db92-49f7-8818-744a7864d573 req-dcbc9337-0b8a-4e9a-84d0-b75900a3c745 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Refreshing network info cache for port abbdb247-c34c-4e34-a214-4752c749a42a {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:48:29 user nova-compute[74646]:   <uuid>042a78ac-e95b-45ae-8a9f-9fc0be22881c</uuid>
Oct 26 15:48:29 user nova-compute[74646]:   <name>instance-00000003</name>
Oct 26 15:48:29 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:48:29 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:48:29 user nova-compute[74646]:   <metadata>
Oct 26 15:48:29 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:48:29 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:48:29 user nova-compute[74646]:       <nova:name>tempest-DeleteServersTestJSON-server-168873447</nova:name>
Oct 26 15:48:29 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:48:28</nova:creationTime>
Oct 26 15:48:29 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:48:29 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:48:29 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:48:29 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:48:29 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:48:29 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:48:29 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:48:29 user nova-compute[74646]:       <nova:owner>
Oct 26 15:48:29 user nova-compute[74646]:         <nova:user uuid="243594cee6354d3c9b908d2d51d07186">tempest-DeleteServersTestJSON-1914251399-project-member</nova:user>
Oct 26 15:48:29 user nova-compute[74646]:         <nova:project uuid="5f56a4ff471842b08578b281d4c7f6ab">tempest-DeleteServersTestJSON-1914251399</nova:project>
Oct 26 15:48:29 user nova-compute[74646]:       </nova:owner>
Oct 26 15:48:29 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:48:29 user nova-compute[74646]:       <nova:ports>
Oct 26 15:48:29 user nova-compute[74646]:         <nova:port uuid="abbdb247-c34c-4e34-a214-4752c749a42a">
Oct 26 15:48:29 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 15:48:29 user nova-compute[74646]:         </nova:port>
Oct 26 15:48:29 user nova-compute[74646]:       </nova:ports>
Oct 26 15:48:29 user nova-compute[74646]:     </nova:instance>
Oct 26 15:48:29 user nova-compute[74646]:   </metadata>
Oct 26 15:48:29 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:48:29 user nova-compute[74646]:     <system>
Oct 26 15:48:29 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:48:29 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:48:29 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:48:29 user nova-compute[74646]:       <entry name="serial">042a78ac-e95b-45ae-8a9f-9fc0be22881c</entry>
Oct 26 15:48:29 user nova-compute[74646]:       <entry name="uuid">042a78ac-e95b-45ae-8a9f-9fc0be22881c</entry>
Oct 26 15:48:29 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:48:29 user nova-compute[74646]:     </system>
Oct 26 15:48:29 user nova-compute[74646]:   </sysinfo>
Oct 26 15:48:29 user nova-compute[74646]:   <os>
Oct 26 15:48:29 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:48:29 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:48:29 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:48:29 user nova-compute[74646]:   </os>
Oct 26 15:48:29 user nova-compute[74646]:   <features>
Oct 26 15:48:29 user nova-compute[74646]:     <acpi/>
Oct 26 15:48:29 user nova-compute[74646]:     <apic/>
Oct 26 15:48:29 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:48:29 user nova-compute[74646]:   </features>
Oct 26 15:48:29 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:48:29 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:48:29 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:48:29 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:48:29 user nova-compute[74646]:   </clock>
Oct 26 15:48:29 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:48:29 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:48:29 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:48:29 user nova-compute[74646]:   </cpu>
Oct 26 15:48:29 user nova-compute[74646]:   <devices>
Oct 26 15:48:29 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:48:29 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:48:29 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk"/>
Oct 26 15:48:29 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:48:29 user nova-compute[74646]:     </disk>
Oct 26 15:48:29 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:48:29 user nova-compute[74646]:       <mac address="fa:16:3e:4d:1f:9f"/>
Oct 26 15:48:29 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:48:29 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:48:29 user nova-compute[74646]:       <target dev="tapabbdb247-c3"/>
Oct 26 15:48:29 user nova-compute[74646]:     </interface>
Oct 26 15:48:29 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:48:29 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/console.log" append="off"/>
Oct 26 15:48:29 user nova-compute[74646]:     </serial>
Oct 26 15:48:29 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:48:29 user nova-compute[74646]:     <video>
Oct 26 15:48:29 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:48:29 user nova-compute[74646]:     </video>
Oct 26 15:48:29 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:48:29 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:48:29 user nova-compute[74646]:     </rng>
Oct 26 15:48:29 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:48:29 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:48:29 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:48:29 user nova-compute[74646]:     </memballoon>
Oct 26 15:48:29 user nova-compute[74646]:   </devices>
Oct 26 15:48:29 user nova-compute[74646]: </domain>
Oct 26 15:48:29 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:48:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-168873447',display_name='tempest-DeleteServersTestJSON-server-168873447',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-168873447',id=3,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f56a4ff471842b08578b281d4c7f6ab',ramdisk_id='',reservation_id='r-qiz3f51v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1914251399',owner_user_name='tempest-DeleteServersTestJSON-1914251399-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:48:21Z,user_data=None,user_id='243594cee6354d3c9b908d2d51d07186',uuid=042a78ac-e95b-45ae-8a9f-9fc0be22881c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abbdb247-c34c-4e34-a214-4752c749a42a", "address": "fa:16:3e:4d:1f:9f", "network": {"id": "206b243c-9e14-4604-8007-2184c3ab67d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1553675839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f56a4ff471842b08578b281d4c7f6ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbdb247-c3", "ovs_interfaceid": "abbdb247-c34c-4e34-a214-4752c749a42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Converting VIF {"id": "abbdb247-c34c-4e34-a214-4752c749a42a", "address": "fa:16:3e:4d:1f:9f", "network": {"id": "206b243c-9e14-4604-8007-2184c3ab67d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1553675839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f56a4ff471842b08578b281d4c7f6ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbdb247-c3", "ovs_interfaceid": "abbdb247-c34c-4e34-a214-4752c749a42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:1f:9f,bridge_name='br-int',has_traffic_filtering=True,id=abbdb247-c34c-4e34-a214-4752c749a42a,network=Network(206b243c-9e14-4604-8007-2184c3ab67d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbdb247-c3') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG os_vif [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:1f:9f,bridge_name='br-int',has_traffic_filtering=True,id=abbdb247-c34c-4e34-a214-4752c749a42a,network=Network(206b243c-9e14-4604-8007-2184c3ab67d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbdb247-c3') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9101465f-50f4-5a26-b9f8-b867ee2fc402', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] No VIF found with MAC fa:16:3e:81:8c:c3, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabbdb247-c3, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabbdb247-c3, col_values=(('qos', UUID('2eeeae4a-c21c-45da-96d1-046019f978e4')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabbdb247-c3, col_values=(('external_ids', {'iface-id': 'abbdb247-c34c-4e34-a214-4752c749a42a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:1f:9f', 'vm-uuid': '042a78ac-e95b-45ae-8a9f-9fc0be22881c'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] No VIF found with MAC fa:16:3e:2e:e2:50, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:29 user nova-compute[74646]: INFO os_vif [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:1f:9f,bridge_name='br-int',has_traffic_filtering=True,id=abbdb247-c34c-4e34-a214-4752c749a42a,network=Network(206b243c-9e14-4604-8007-2184c3ab67d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbdb247-c3')
Oct 26 15:48:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] No VIF found with MAC fa:16:3e:4d:1f:9f, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG nova.network.neutron [req-47150700-db92-49f7-8818-744a7864d573 req-dcbc9337-0b8a-4e9a-84d0-b75900a3c745 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Updated VIF entry in instance network info cache for port abbdb247-c34c-4e34-a214-4752c749a42a. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG nova.network.neutron [req-47150700-db92-49f7-8818-744a7864d573 req-dcbc9337-0b8a-4e9a-84d0-b75900a3c745 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Updating instance_info_cache with network_info: [{"id": "abbdb247-c34c-4e34-a214-4752c749a42a", "address": "fa:16:3e:4d:1f:9f", "network": {"id": "206b243c-9e14-4604-8007-2184c3ab67d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1553675839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f56a4ff471842b08578b281d4c7f6ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbdb247-c3", "ovs_interfaceid": "abbdb247-c34c-4e34-a214-4752c749a42a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-47150700-db92-49f7-8818-744a7864d573 req-dcbc9337-0b8a-4e9a-84d0-b75900a3c745 service nova] Releasing lock "refresh_cache-042a78ac-e95b-45ae-8a9f-9fc0be22881c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:48:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:30 user nova-compute[74646]: DEBUG nova.network.neutron [req-7d1f0a9c-0efe-4540-a8bd-4cfe96bd851c req-4a34f47e-f24c-4a88-a861-42d3f01e9421 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Updated VIF entry in instance network info cache for port e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:48:30 user nova-compute[74646]: DEBUG nova.network.neutron [req-7d1f0a9c-0efe-4540-a8bd-4cfe96bd851c req-4a34f47e-f24c-4a88-a861-42d3f01e9421 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Updating instance_info_cache with network_info: [{"id": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "address": "fa:16:3e:81:8c:c3", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59d9ca3-b8", "ovs_interfaceid": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:48:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7d1f0a9c-0efe-4540-a8bd-4cfe96bd851c req-4a34f47e-f24c-4a88-a861-42d3f01e9421 service nova] Releasing lock "refresh_cache-5e42f38e-e10f-43b7-89ab-ab22addfcf95" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:48:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:48:35 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Instance spawned successfully.
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:48:35 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Instance spawned successfully.
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: INFO nova.compute.manager [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Took 16.15 seconds to spawn the instance on the hypervisor.
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:48:35 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Instance spawned successfully.
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:35 user nova-compute[74646]: INFO nova.compute.manager [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Took 14.17 seconds to spawn the instance on the hypervisor.
Oct 26 15:48:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:48:35 user nova-compute[74646]: INFO nova.compute.manager [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Took 17.51 seconds to build instance.
Oct 26 15:48:36 user nova-compute[74646]: INFO nova.compute.manager [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Took 15.45 seconds to spawn the instance on the hypervisor.
Oct 26 15:48:36 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:48:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a7200092-26be-487f-820f-8ef0aa5f506a tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.743s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:36 user nova-compute[74646]: INFO nova.compute.manager [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Took 15.23 seconds to build instance.
Oct 26 15:48:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741570ce-ca45-40c2-9a2e-d77f272c057d tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.630s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:36 user nova-compute[74646]: INFO nova.compute.manager [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Took 17.26 seconds to build instance.
Oct 26 15:48:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2776f61-4bb7-4e4f-accd-1313778cca02 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.412s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "0c76f879-d140-484b-89ed-8d4012f44a7f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:39 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:48:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:39 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:48:39 user nova-compute[74646]: INFO nova.compute.claims [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Claim successful on node user
Oct 26 15:48:40 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:48:40 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:48:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:48:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:48:40 user nova-compute[74646]: DEBUG nova.network.neutron [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:48:40 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 26 15:48:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:48:40 user nova-compute[74646]: DEBUG nova.policy [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd1e8f58ce51848e8a2824c1f5fe44cc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8efc31ce8cd746c2b17e13aee9014810', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:48:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:48:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:48:40 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Creating image(s)
Oct 26 15:48:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "/opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "/opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "9ec4f32031c78e736c1e06efd265f2e50450d827" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "9ec4f32031c78e736c1e06efd265f2e50450d827" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827.part --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827.part --force-share --output=json" returned: 0 in 0.236s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:41 user nova-compute[74646]: DEBUG nova.virt.images [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] 51064f1f-0962-4845-b994-96520ef9f2ee was qcow2, converting to raw {{(pid=74646) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 15:48:41 user nova-compute[74646]: DEBUG nova.privsep.utils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74646) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 15:48:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827.part /opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827.converted {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:41 user nova-compute[74646]: DEBUG nova.network.neutron [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Successfully created port: 2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:48:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827.part /opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827.converted" returned: 0 in 0.216s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827.converted --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827.converted --force-share --output=json" returned: 0 in 0.287s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "9ec4f32031c78e736c1e06efd265f2e50450d827" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.572s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827 --force-share --output=json" returned: 0 in 0.269s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "9ec4f32031c78e736c1e06efd265f2e50450d827" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "9ec4f32031c78e736c1e06efd265f2e50450d827" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG nova.network.neutron [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Successfully updated port: 2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "refresh_cache-0c76f879-d140-484b-89ed-8d4012f44a7f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquired lock "refresh_cache-0c76f879-d140-484b-89ed-8d4012f44a7f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG nova.network.neutron [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-21bca182-bb79-43af-a2d9-3fbee1412c54 req-2deb0192-4d04-423f-b38e-161b9083b384 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Received event network-changed-2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-21bca182-bb79-43af-a2d9-3fbee1412c54 req-2deb0192-4d04-423f-b38e-161b9083b384 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Refreshing instance network info cache due to event network-changed-2a89712c-1508-4385-941b-b8bea7de3c35. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-21bca182-bb79-43af-a2d9-3fbee1412c54 req-2deb0192-4d04-423f-b38e-161b9083b384 service nova] Acquiring lock "refresh_cache-0c76f879-d140-484b-89ed-8d4012f44a7f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827 --force-share --output=json" returned: 0 in 0.210s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827,backing_fmt=raw /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827,backing_fmt=raw /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk 1073741824" returned: 0 in 0.059s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "9ec4f32031c78e736c1e06efd265f2e50450d827" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:42 user nova-compute[74646]: DEBUG nova.network.neutron [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9ec4f32031c78e736c1e06efd265f2e50450d827 --force-share --output=json" returned: 0 in 0.222s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Cannot resize image /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Ensure instance console log exists: /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.network.neutron [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Updating instance_info_cache with network_info: [{"id": "2a89712c-1508-4385-941b-b8bea7de3c35", "address": "fa:16:3e:51:bc:da", "network": {"id": "99cf3989-5b18-4c8f-82f2-719e0019fe32", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-341987946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8efc31ce8cd746c2b17e13aee9014810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a89712c-15", "ovs_interfaceid": "2a89712c-1508-4385-941b-b8bea7de3c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Releasing lock "refresh_cache-0c76f879-d140-484b-89ed-8d4012f44a7f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Instance network_info: |[{"id": "2a89712c-1508-4385-941b-b8bea7de3c35", "address": "fa:16:3e:51:bc:da", "network": {"id": "99cf3989-5b18-4c8f-82f2-719e0019fe32", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-341987946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8efc31ce8cd746c2b17e13aee9014810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a89712c-15", "ovs_interfaceid": "2a89712c-1508-4385-941b-b8bea7de3c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-21bca182-bb79-43af-a2d9-3fbee1412c54 req-2deb0192-4d04-423f-b38e-161b9083b384 service nova] Acquired lock "refresh_cache-0c76f879-d140-484b-89ed-8d4012f44a7f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.network.neutron [req-21bca182-bb79-43af-a2d9-3fbee1412c54 req-2deb0192-4d04-423f-b38e-161b9083b384 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Refreshing network info cache for port 2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Start _get_guest_xml network_info=[{"id": "2a89712c-1508-4385-941b-b8bea7de3c35", "address": "fa:16:3e:51:bc:da", "network": {"id": "99cf3989-5b18-4c8f-82f2-719e0019fe32", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-341987946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8efc31ce8cd746c2b17e13aee9014810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a89712c-15", "ovs_interfaceid": "2a89712c-1508-4385-941b-b8bea7de3c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:48:32Z,direct_url=<?>,disk_format='qcow2',id=51064f1f-0962-4845-b994-96520ef9f2ee,min_disk=0,min_ram=0,name='',owner='b309537f7029472fa58a38b3b4a2b19d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:48:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'scsi', 'size': 0, 'device_name': '/dev/sda', 'encryption_options': None, 'image_id': '51064f1f-0962-4845-b994-96520ef9f2ee'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:48:43 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:48:43 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:48:32Z,direct_url=<?>,disk_format='qcow2',id=51064f1f-0962-4845-b994-96520ef9f2ee,min_disk=0,min_ram=0,name='',owner='b309537f7029472fa58a38b3b4a2b19d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:48:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1676663822',display_name='tempest-AttachSCSIVolumeTestJSON-server-1676663822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1676663822',id=4,image_ref='51064f1f-0962-4845-b994-96520ef9f2ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz/nBxtRdUl8eOJ5U4NfLmocwlMKHBcNdgJqvDFCr7HPujSsXX1Y9MtFaFXWFR1I3fbWSjlGlVfsZ1ruASV6GcyBpto4uer29ps785s1ff1kH4h5CpdyW7z3oCttVoYXA==',key_name='tempest-keypair-847108979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8efc31ce8cd746c2b17e13aee9014810',ramdisk_id='',reservation_id='r-eu9kavcz',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='51064f1f-0962-4845-b994-96520ef9f2ee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1961026020',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1961026020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1e8f58ce51848e8a2824c1f5fe44cc4',uuid=0c76f879-d140-484b-89ed-8d4012f44a7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a89712c-1508-4385-941b-b8bea7de3c35", "address": "fa:16:3e:51:bc:da", "network": {"id": "99cf3989-5b18-4c8f-82f2-719e0019fe32", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-341987946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8efc31ce8cd746c2b17e13aee9014810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a89712c-15", "ovs_interfaceid": "2a89712c-1508-4385-941b-b8bea7de3c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Converting VIF {"id": "2a89712c-1508-4385-941b-b8bea7de3c35", "address": "fa:16:3e:51:bc:da", "network": {"id": "99cf3989-5b18-4c8f-82f2-719e0019fe32", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-341987946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8efc31ce8cd746c2b17e13aee9014810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a89712c-15", "ovs_interfaceid": "2a89712c-1508-4385-941b-b8bea7de3c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:bc:da,bridge_name='br-int',has_traffic_filtering=True,id=2a89712c-1508-4385-941b-b8bea7de3c35,network=Network(99cf3989-5b18-4c8f-82f2-719e0019fe32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a89712c-15') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.objects.instance [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c76f879-d140-484b-89ed-8d4012f44a7f {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:48:43 user nova-compute[74646]:   <uuid>0c76f879-d140-484b-89ed-8d4012f44a7f</uuid>
Oct 26 15:48:43 user nova-compute[74646]:   <name>instance-00000004</name>
Oct 26 15:48:43 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:48:43 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:48:43 user nova-compute[74646]:   <metadata>
Oct 26 15:48:43 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:48:43 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:48:43 user nova-compute[74646]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1676663822</nova:name>
Oct 26 15:48:43 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:48:43</nova:creationTime>
Oct 26 15:48:43 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:48:43 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:48:43 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:48:43 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:48:43 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:48:43 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:48:43 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:48:43 user nova-compute[74646]:       <nova:owner>
Oct 26 15:48:43 user nova-compute[74646]:         <nova:user uuid="d1e8f58ce51848e8a2824c1f5fe44cc4">tempest-AttachSCSIVolumeTestJSON-1961026020-project-member</nova:user>
Oct 26 15:48:43 user nova-compute[74646]:         <nova:project uuid="8efc31ce8cd746c2b17e13aee9014810">tempest-AttachSCSIVolumeTestJSON-1961026020</nova:project>
Oct 26 15:48:43 user nova-compute[74646]:       </nova:owner>
Oct 26 15:48:43 user nova-compute[74646]:       <nova:root type="image" uuid="51064f1f-0962-4845-b994-96520ef9f2ee"/>
Oct 26 15:48:43 user nova-compute[74646]:       <nova:ports>
Oct 26 15:48:43 user nova-compute[74646]:         <nova:port uuid="2a89712c-1508-4385-941b-b8bea7de3c35">
Oct 26 15:48:43 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 15:48:43 user nova-compute[74646]:         </nova:port>
Oct 26 15:48:43 user nova-compute[74646]:       </nova:ports>
Oct 26 15:48:43 user nova-compute[74646]:     </nova:instance>
Oct 26 15:48:43 user nova-compute[74646]:   </metadata>
Oct 26 15:48:43 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:48:43 user nova-compute[74646]:     <system>
Oct 26 15:48:43 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:48:43 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:48:43 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:48:43 user nova-compute[74646]:       <entry name="serial">0c76f879-d140-484b-89ed-8d4012f44a7f</entry>
Oct 26 15:48:43 user nova-compute[74646]:       <entry name="uuid">0c76f879-d140-484b-89ed-8d4012f44a7f</entry>
Oct 26 15:48:43 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:48:43 user nova-compute[74646]:     </system>
Oct 26 15:48:43 user nova-compute[74646]:   </sysinfo>
Oct 26 15:48:43 user nova-compute[74646]:   <os>
Oct 26 15:48:43 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:48:43 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:48:43 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:48:43 user nova-compute[74646]:   </os>
Oct 26 15:48:43 user nova-compute[74646]:   <features>
Oct 26 15:48:43 user nova-compute[74646]:     <acpi/>
Oct 26 15:48:43 user nova-compute[74646]:     <apic/>
Oct 26 15:48:43 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:48:43 user nova-compute[74646]:   </features>
Oct 26 15:48:43 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:48:43 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:48:43 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:48:43 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:48:43 user nova-compute[74646]:   </clock>
Oct 26 15:48:43 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:48:43 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:48:43 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:48:43 user nova-compute[74646]:   </cpu>
Oct 26 15:48:43 user nova-compute[74646]:   <devices>
Oct 26 15:48:43 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:48:43 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:48:43 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk"/>
Oct 26 15:48:43 user nova-compute[74646]:       <target dev="sda" bus="scsi"/>
Oct 26 15:48:43 user nova-compute[74646]:       <address type="drive" controller="0" unit="0"/>
Oct 26 15:48:43 user nova-compute[74646]:     </disk>
Oct 26 15:48:43 user nova-compute[74646]:     <disk type="file" device="cdrom">
Oct 26 15:48:43 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 15:48:43 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk.config"/>
Oct 26 15:48:43 user nova-compute[74646]:       <target dev="sdb" bus="scsi"/>
Oct 26 15:48:43 user nova-compute[74646]:       <address type="drive" controller="0" unit="1"/>
Oct 26 15:48:43 user nova-compute[74646]:     </disk>
Oct 26 15:48:43 user nova-compute[74646]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 26 15:48:43 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:48:43 user nova-compute[74646]:       <mac address="fa:16:3e:51:bc:da"/>
Oct 26 15:48:43 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:48:43 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:48:43 user nova-compute[74646]:       <target dev="tap2a89712c-15"/>
Oct 26 15:48:43 user nova-compute[74646]:     </interface>
Oct 26 15:48:43 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:48:43 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/console.log" append="off"/>
Oct 26 15:48:43 user nova-compute[74646]:     </serial>
Oct 26 15:48:43 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:48:43 user nova-compute[74646]:     <video>
Oct 26 15:48:43 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:48:43 user nova-compute[74646]:     </video>
Oct 26 15:48:43 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:48:43 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:48:43 user nova-compute[74646]:     </rng>
Oct 26 15:48:43 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:48:43 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:48:43 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:48:43 user nova-compute[74646]:     </memballoon>
Oct 26 15:48:43 user nova-compute[74646]:   </devices>
Oct 26 15:48:43 user nova-compute[74646]: </domain>
Oct 26 15:48:43 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1676663822',display_name='tempest-AttachSCSIVolumeTestJSON-server-1676663822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1676663822',id=4,image_ref='51064f1f-0962-4845-b994-96520ef9f2ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz/nBxtRdUl8eOJ5U4NfLmocwlMKHBcNdgJqvDFCr7HPujSsXX1Y9MtFaFXWFR1I3fbWSjlGlVfsZ1ruASV6GcyBpto4uer29ps785s1ff1kH4h5CpdyW7z3oCttVoYXA==',key_name='tempest-keypair-847108979',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8efc31ce8cd746c2b17e13aee9014810',ramdisk_id='',reservation_id='r-eu9kavcz',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='51064f1f-0962-4845-b994-96520ef9f2ee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1961026020',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1961026020-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:48:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1e8f58ce51848e8a2824c1f5fe44cc4',uuid=0c76f879-d140-484b-89ed-8d4012f44a7f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a89712c-1508-4385-941b-b8bea7de3c35", "address": "fa:16:3e:51:bc:da", "network": {"id": "99cf3989-5b18-4c8f-82f2-719e0019fe32", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-341987946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8efc31ce8cd746c2b17e13aee9014810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a89712c-15", "ovs_interfaceid": "2a89712c-1508-4385-941b-b8bea7de3c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Converting VIF {"id": "2a89712c-1508-4385-941b-b8bea7de3c35", "address": "fa:16:3e:51:bc:da", "network": {"id": "99cf3989-5b18-4c8f-82f2-719e0019fe32", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-341987946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8efc31ce8cd746c2b17e13aee9014810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a89712c-15", "ovs_interfaceid": "2a89712c-1508-4385-941b-b8bea7de3c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:51:bc:da,bridge_name='br-int',has_traffic_filtering=True,id=2a89712c-1508-4385-941b-b8bea7de3c35,network=Network(99cf3989-5b18-4c8f-82f2-719e0019fe32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a89712c-15') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG os_vif [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:bc:da,bridge_name='br-int',has_traffic_filtering=True,id=2a89712c-1508-4385-941b-b8bea7de3c35,network=Network(99cf3989-5b18-4c8f-82f2-719e0019fe32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a89712c-15') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef0df0d2-54cd-5543-b2e8-d6fe89121c53', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a89712c-15, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a89712c-15, col_values=(('qos', UUID('c32e0323-6fd7-43ff-b64a-7a9cedf257a8')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a89712c-15, col_values=(('external_ids', {'iface-id': '2a89712c-1508-4385-941b-b8bea7de3c35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:51:bc:da', 'vm-uuid': '0c76f879-d140-484b-89ed-8d4012f44a7f'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:43 user nova-compute[74646]: INFO os_vif [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:51:bc:da,bridge_name='br-int',has_traffic_filtering=True,id=2a89712c-1508-4385-941b-b8bea7de3c35,network=Network(99cf3989-5b18-4c8f-82f2-719e0019fe32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a89712c-15')
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] No BDM found with device name sda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:48:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] No VIF found with MAC fa:16:3e:51:bc:da, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:48:43 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Using config drive
Oct 26 15:48:44 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Creating config drive at /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk.config
Oct 26 15:48:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2plksn4h {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2plksn4h" returned: 0 in 0.068s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:44 user nova-compute[74646]: DEBUG nova.network.neutron [req-21bca182-bb79-43af-a2d9-3fbee1412c54 req-2deb0192-4d04-423f-b38e-161b9083b384 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Updated VIF entry in instance network info cache for port 2a89712c-1508-4385-941b-b8bea7de3c35. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:48:44 user nova-compute[74646]: DEBUG nova.network.neutron [req-21bca182-bb79-43af-a2d9-3fbee1412c54 req-2deb0192-4d04-423f-b38e-161b9083b384 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Updating instance_info_cache with network_info: [{"id": "2a89712c-1508-4385-941b-b8bea7de3c35", "address": "fa:16:3e:51:bc:da", "network": {"id": "99cf3989-5b18-4c8f-82f2-719e0019fe32", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-341987946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8efc31ce8cd746c2b17e13aee9014810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a89712c-15", "ovs_interfaceid": "2a89712c-1508-4385-941b-b8bea7de3c35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:48:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-21bca182-bb79-43af-a2d9-3fbee1412c54 req-2deb0192-4d04-423f-b38e-161b9083b384 service nova] Releasing lock "refresh_cache-0c76f879-d140-484b-89ed-8d4012f44a7f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:48:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:48:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:48:48 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Instance spawned successfully.
Oct 26 15:48:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:48:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:48 user nova-compute[74646]: INFO nova.compute.manager [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Took 8.15 seconds to spawn the instance on the hypervisor.
Oct 26 15:48:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:48:48 user nova-compute[74646]: INFO nova.compute.manager [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Took 9.13 seconds to build instance.
Oct 26 15:48:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d43d0eda-35a9-4eb1-98fc-8f1c6eacd6cb tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.314s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Acquiring lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:49 user nova-compute[74646]: DEBUG nova.compute.manager [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:48:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:49 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:48:49 user nova-compute[74646]: INFO nova.compute.claims [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Claim successful on node user
Oct 26 15:48:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:49 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:48:49 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:48:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:49 user nova-compute[74646]: DEBUG nova.compute.manager [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG nova.compute.manager [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG nova.network.neutron [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:48:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:48:50 user nova-compute[74646]: DEBUG nova.compute.manager [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG nova.policy [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0ae7d2eb76845c8af23a8c143035e87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9be77f8e6c0f4a21beabacb7a88f3d02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG nova.compute.manager [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:48:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Creating image(s)
Oct 26 15:48:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Acquiring lock "/opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "/opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "/opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.282s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-3affec51-70f8-49f6-84c6-891573e2ccd1 req-dc31bd3e-8d6f-4e1f-a90c-607270f7a5cd service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Received event network-vif-plugged-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3affec51-70f8-49f6-84c6-891573e2ccd1 req-dc31bd3e-8d6f-4e1f-a90c-607270f7a5cd service nova] Acquiring lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3affec51-70f8-49f6-84c6-891573e2ccd1 req-dc31bd3e-8d6f-4e1f-a90c-607270f7a5cd service nova] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3affec51-70f8-49f6-84c6-891573e2ccd1 req-dc31bd3e-8d6f-4e1f-a90c-607270f7a5cd service nova] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-3affec51-70f8-49f6-84c6-891573e2ccd1 req-dc31bd3e-8d6f-4e1f-a90c-607270f7a5cd service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] No waiting events found dispatching network-vif-plugged-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:48:50 user nova-compute[74646]: WARNING nova.compute.manager [req-3affec51-70f8-49f6-84c6-891573e2ccd1 req-dc31bd3e-8d6f-4e1f-a90c-607270f7a5cd service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Received unexpected event network-vif-plugged-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc for instance with vm_state active and task_state None.
Oct 26 15:48:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.282s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk 1073741824" returned: 0 in 0.059s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.348s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.317s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:51 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Checking if we can resize image /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:48:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:48:51 user nova-compute[74646]: DEBUG nova.network.neutron [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Successfully created port: c9175401-a233-4208-989d-72f952608659 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:48:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json" returned: 0 in 0.309s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:48:51 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Cannot resize image /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:48:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:48:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Ensure instance console log exists: /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:48:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Received event network-vif-plugged-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] Acquiring lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] No waiting events found dispatching network-vif-plugged-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:48:52 user nova-compute[74646]: WARNING nova.compute.manager [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Received unexpected event network-vif-plugged-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc for instance with vm_state active and task_state None.
Oct 26 15:48:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Received event network-vif-plugged-abbdb247-c34c-4e34-a214-4752c749a42a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] Acquiring lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] No waiting events found dispatching network-vif-plugged-abbdb247-c34c-4e34-a214-4752c749a42a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:48:52 user nova-compute[74646]: WARNING nova.compute.manager [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Received unexpected event network-vif-plugged-abbdb247-c34c-4e34-a214-4752c749a42a for instance with vm_state active and task_state None.
Oct 26 15:48:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Received event network-vif-plugged-abbdb247-c34c-4e34-a214-4752c749a42a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] Acquiring lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] No waiting events found dispatching network-vif-plugged-abbdb247-c34c-4e34-a214-4752c749a42a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:48:52 user nova-compute[74646]: WARNING nova.compute.manager [req-c65ffe16-0b1e-4452-894b-2624d624ebad req-164213d7-e133-4b9e-95ec-bfa169adc981 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Received unexpected event network-vif-plugged-abbdb247-c34c-4e34-a214-4752c749a42a for instance with vm_state active and task_state None.
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.network.neutron [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Successfully updated port: c9175401-a233-4208-989d-72f952608659 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Acquiring lock "refresh_cache-be9a6bab-6958-43bb-9ed8-a531e05ed98d" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Acquired lock "refresh_cache-be9a6bab-6958-43bb-9ed8-a531e05ed98d" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.network.neutron [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.network.neutron [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.network.neutron [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Updating instance_info_cache with network_info: [{"id": "c9175401-a233-4208-989d-72f952608659", "address": "fa:16:3e:4e:a7:bf", "network": {"id": "f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702566873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9be77f8e6c0f4a21beabacb7a88f3d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9175401-a2", "ovs_interfaceid": "c9175401-a233-4208-989d-72f952608659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Releasing lock "refresh_cache-be9a6bab-6958-43bb-9ed8-a531e05ed98d" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.compute.manager [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Instance network_info: |[{"id": "c9175401-a233-4208-989d-72f952608659", "address": "fa:16:3e:4e:a7:bf", "network": {"id": "f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702566873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9be77f8e6c0f4a21beabacb7a88f3d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9175401-a2", "ovs_interfaceid": "c9175401-a233-4208-989d-72f952608659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Start _get_guest_xml network_info=[{"id": "c9175401-a233-4208-989d-72f952608659", "address": "fa:16:3e:4e:a7:bf", "network": {"id": "f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702566873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9be77f8e6c0f4a21beabacb7a88f3d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9175401-a2", "ovs_interfaceid": "c9175401-a233-4208-989d-72f952608659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:48:53 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:48:53 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-472888418',display_name='tempest-VolumesAssistedSnapshotsTest-server-472888418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-472888418',id=5,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFpZc6Ehu3IYF8RQAWPuhRN5BWJgnEFAOhIeB8bMiuLpOWH1GF/ayvCUM/yuZLad7tgIUQy/M+13dW+XhlUeQEr+bsfguR1zykU+yY6ju8JBfk6PfFi3Po3V5+BGHkXhQ==',key_name='tempest-keypair-1603528482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9be77f8e6c0f4a21beabacb7a88f3d02',ramdisk_id='',reservation_id='r-8txe0y07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2127871605',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2127871605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ae7d2eb76845c8af23a8c143035e87',uuid=be9a6bab-6958-43bb-9ed8-a531e05ed98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9175401-a233-4208-989d-72f952608659", "address": "fa:16:3e:4e:a7:bf", "network": {"id": "f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702566873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9be77f8e6c0f4a21beabacb7a88f3d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9175401-a2", "ovs_interfaceid": "c9175401-a233-4208-989d-72f952608659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Converting VIF {"id": "c9175401-a233-4208-989d-72f952608659", "address": "fa:16:3e:4e:a7:bf", "network": {"id": "f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702566873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9be77f8e6c0f4a21beabacb7a88f3d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9175401-a2", "ovs_interfaceid": "c9175401-a233-4208-989d-72f952608659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a7:bf,bridge_name='br-int',has_traffic_filtering=True,id=c9175401-a233-4208-989d-72f952608659,network=Network(f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9175401-a2') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.objects.instance [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lazy-loading 'pci_devices' on Instance uuid be9a6bab-6958-43bb-9ed8-a531e05ed98d {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:48:53 user nova-compute[74646]:   <uuid>be9a6bab-6958-43bb-9ed8-a531e05ed98d</uuid>
Oct 26 15:48:53 user nova-compute[74646]:   <name>instance-00000005</name>
Oct 26 15:48:53 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:48:53 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:48:53 user nova-compute[74646]:   <metadata>
Oct 26 15:48:53 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:48:53 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:48:53 user nova-compute[74646]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-472888418</nova:name>
Oct 26 15:48:53 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:48:53</nova:creationTime>
Oct 26 15:48:53 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:48:53 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:48:53 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:48:53 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:48:53 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:48:53 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:48:53 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:48:53 user nova-compute[74646]:       <nova:owner>
Oct 26 15:48:53 user nova-compute[74646]:         <nova:user uuid="a0ae7d2eb76845c8af23a8c143035e87">tempest-VolumesAssistedSnapshotsTest-2127871605-project-member</nova:user>
Oct 26 15:48:53 user nova-compute[74646]:         <nova:project uuid="9be77f8e6c0f4a21beabacb7a88f3d02">tempest-VolumesAssistedSnapshotsTest-2127871605</nova:project>
Oct 26 15:48:53 user nova-compute[74646]:       </nova:owner>
Oct 26 15:48:53 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:48:53 user nova-compute[74646]:       <nova:ports>
Oct 26 15:48:53 user nova-compute[74646]:         <nova:port uuid="c9175401-a233-4208-989d-72f952608659">
Oct 26 15:48:53 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 15:48:53 user nova-compute[74646]:         </nova:port>
Oct 26 15:48:53 user nova-compute[74646]:       </nova:ports>
Oct 26 15:48:53 user nova-compute[74646]:     </nova:instance>
Oct 26 15:48:53 user nova-compute[74646]:   </metadata>
Oct 26 15:48:53 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:48:53 user nova-compute[74646]:     <system>
Oct 26 15:48:53 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:48:53 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:48:53 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:48:53 user nova-compute[74646]:       <entry name="serial">be9a6bab-6958-43bb-9ed8-a531e05ed98d</entry>
Oct 26 15:48:53 user nova-compute[74646]:       <entry name="uuid">be9a6bab-6958-43bb-9ed8-a531e05ed98d</entry>
Oct 26 15:48:53 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:48:53 user nova-compute[74646]:     </system>
Oct 26 15:48:53 user nova-compute[74646]:   </sysinfo>
Oct 26 15:48:53 user nova-compute[74646]:   <os>
Oct 26 15:48:53 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:48:53 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:48:53 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:48:53 user nova-compute[74646]:   </os>
Oct 26 15:48:53 user nova-compute[74646]:   <features>
Oct 26 15:48:53 user nova-compute[74646]:     <acpi/>
Oct 26 15:48:53 user nova-compute[74646]:     <apic/>
Oct 26 15:48:53 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:48:53 user nova-compute[74646]:   </features>
Oct 26 15:48:53 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:48:53 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:48:53 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:48:53 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:48:53 user nova-compute[74646]:   </clock>
Oct 26 15:48:53 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:48:53 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:48:53 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:48:53 user nova-compute[74646]:   </cpu>
Oct 26 15:48:53 user nova-compute[74646]:   <devices>
Oct 26 15:48:53 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:48:53 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:48:53 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk"/>
Oct 26 15:48:53 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:48:53 user nova-compute[74646]:     </disk>
Oct 26 15:48:53 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:48:53 user nova-compute[74646]:       <mac address="fa:16:3e:4e:a7:bf"/>
Oct 26 15:48:53 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:48:53 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:48:53 user nova-compute[74646]:       <target dev="tapc9175401-a2"/>
Oct 26 15:48:53 user nova-compute[74646]:     </interface>
Oct 26 15:48:53 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:48:53 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/console.log" append="off"/>
Oct 26 15:48:53 user nova-compute[74646]:     </serial>
Oct 26 15:48:53 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:48:53 user nova-compute[74646]:     <video>
Oct 26 15:48:53 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:48:53 user nova-compute[74646]:     </video>
Oct 26 15:48:53 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:48:53 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:48:53 user nova-compute[74646]:     </rng>
Oct 26 15:48:53 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:48:53 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:48:53 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:48:53 user nova-compute[74646]:     </memballoon>
Oct 26 15:48:53 user nova-compute[74646]:   </devices>
Oct 26 15:48:53 user nova-compute[74646]: </domain>
Oct 26 15:48:53 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-472888418',display_name='tempest-VolumesAssistedSnapshotsTest-server-472888418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-472888418',id=5,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFpZc6Ehu3IYF8RQAWPuhRN5BWJgnEFAOhIeB8bMiuLpOWH1GF/ayvCUM/yuZLad7tgIUQy/M+13dW+XhlUeQEr+bsfguR1zykU+yY6ju8JBfk6PfFi3Po3V5+BGHkXhQ==',key_name='tempest-keypair-1603528482',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9be77f8e6c0f4a21beabacb7a88f3d02',ramdisk_id='',reservation_id='r-8txe0y07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2127871605',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2127871605-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ae7d2eb76845c8af23a8c143035e87',uuid=be9a6bab-6958-43bb-9ed8-a531e05ed98d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9175401-a233-4208-989d-72f952608659", "address": "fa:16:3e:4e:a7:bf", "network": {"id": "f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702566873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9be77f8e6c0f4a21beabacb7a88f3d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9175401-a2", "ovs_interfaceid": "c9175401-a233-4208-989d-72f952608659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Converting VIF {"id": "c9175401-a233-4208-989d-72f952608659", "address": "fa:16:3e:4e:a7:bf", "network": {"id": "f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702566873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9be77f8e6c0f4a21beabacb7a88f3d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9175401-a2", "ovs_interfaceid": "c9175401-a233-4208-989d-72f952608659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a7:bf,bridge_name='br-int',has_traffic_filtering=True,id=c9175401-a233-4208-989d-72f952608659,network=Network(f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9175401-a2') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG os_vif [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a7:bf,bridge_name='br-int',has_traffic_filtering=True,id=c9175401-a233-4208-989d-72f952608659,network=Network(f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9175401-a2') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5df85d43-8526-5998-8812-6cf0bc57a8ac', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9175401-a2, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9175401-a2, col_values=(('qos', UUID('cbe6349a-8a17-4234-aa59-5f225e4028e7')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9175401-a2, col_values=(('external_ids', {'iface-id': 'c9175401-a233-4208-989d-72f952608659', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:a7:bf', 'vm-uuid': 'be9a6bab-6958-43bb-9ed8-a531e05ed98d'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:53 user nova-compute[74646]: INFO os_vif [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a7:bf,bridge_name='br-int',has_traffic_filtering=True,id=c9175401-a233-4208-989d-72f952608659,network=Network(f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9175401-a2')
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:48:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] No VIF found with MAC fa:16:3e:4e:a7:bf, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:48:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:54 user nova-compute[74646]: DEBUG nova.compute.manager [req-1e738b9a-6075-484e-9948-fb830cd76da8 req-bdeb6524-f73e-4bd1-8075-92d916548492 service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Received event network-changed-c9175401-a233-4208-989d-72f952608659 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:54 user nova-compute[74646]: DEBUG nova.compute.manager [req-1e738b9a-6075-484e-9948-fb830cd76da8 req-bdeb6524-f73e-4bd1-8075-92d916548492 service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Refreshing instance network info cache due to event network-changed-c9175401-a233-4208-989d-72f952608659. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:48:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1e738b9a-6075-484e-9948-fb830cd76da8 req-bdeb6524-f73e-4bd1-8075-92d916548492 service nova] Acquiring lock "refresh_cache-be9a6bab-6958-43bb-9ed8-a531e05ed98d" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:48:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1e738b9a-6075-484e-9948-fb830cd76da8 req-bdeb6524-f73e-4bd1-8075-92d916548492 service nova] Acquired lock "refresh_cache-be9a6bab-6958-43bb-9ed8-a531e05ed98d" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:48:54 user nova-compute[74646]: DEBUG nova.network.neutron [req-1e738b9a-6075-484e-9948-fb830cd76da8 req-bdeb6524-f73e-4bd1-8075-92d916548492 service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Refreshing network info cache for port c9175401-a233-4208-989d-72f952608659 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:48:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:55 user nova-compute[74646]: DEBUG nova.network.neutron [req-1e738b9a-6075-484e-9948-fb830cd76da8 req-bdeb6524-f73e-4bd1-8075-92d916548492 service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Updated VIF entry in instance network info cache for port c9175401-a233-4208-989d-72f952608659. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:48:55 user nova-compute[74646]: DEBUG nova.network.neutron [req-1e738b9a-6075-484e-9948-fb830cd76da8 req-bdeb6524-f73e-4bd1-8075-92d916548492 service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Updating instance_info_cache with network_info: [{"id": "c9175401-a233-4208-989d-72f952608659", "address": "fa:16:3e:4e:a7:bf", "network": {"id": "f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702566873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9be77f8e6c0f4a21beabacb7a88f3d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9175401-a2", "ovs_interfaceid": "c9175401-a233-4208-989d-72f952608659", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:48:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1e738b9a-6075-484e-9948-fb830cd76da8 req-bdeb6524-f73e-4bd1-8075-92d916548492 service nova] Releasing lock "refresh_cache-be9a6bab-6958-43bb-9ed8-a531e05ed98d" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:48:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-cd948082-0fce-4b3b-ba48-3018bebe7e30 req-b9b16af0-dc5f-4ad3-9832-7645067e7bf3 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Received event network-vif-plugged-529d94bf-3278-41ad-b2c1-522b68db2421 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cd948082-0fce-4b3b-ba48-3018bebe7e30 req-b9b16af0-dc5f-4ad3-9832-7645067e7bf3 service nova] Acquiring lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cd948082-0fce-4b3b-ba48-3018bebe7e30 req-b9b16af0-dc5f-4ad3-9832-7645067e7bf3 service nova] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cd948082-0fce-4b3b-ba48-3018bebe7e30 req-b9b16af0-dc5f-4ad3-9832-7645067e7bf3 service nova] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-cd948082-0fce-4b3b-ba48-3018bebe7e30 req-b9b16af0-dc5f-4ad3-9832-7645067e7bf3 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] No waiting events found dispatching network-vif-plugged-529d94bf-3278-41ad-b2c1-522b68db2421 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:48:56 user nova-compute[74646]: WARNING nova.compute.manager [req-cd948082-0fce-4b3b-ba48-3018bebe7e30 req-b9b16af0-dc5f-4ad3-9832-7645067e7bf3 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Received unexpected event network-vif-plugged-529d94bf-3278-41ad-b2c1-522b68db2421 for instance with vm_state active and task_state None.
Oct 26 15:48:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-0359bd09-2353-403f-9a16-6252324c87cf req-005bcdc3-a3e3-4e86-af98-1f803bb02bdf service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Received event network-vif-plugged-c9175401-a233-4208-989d-72f952608659 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0359bd09-2353-403f-9a16-6252324c87cf req-005bcdc3-a3e3-4e86-af98-1f803bb02bdf service nova] Acquiring lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0359bd09-2353-403f-9a16-6252324c87cf req-005bcdc3-a3e3-4e86-af98-1f803bb02bdf service nova] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0359bd09-2353-403f-9a16-6252324c87cf req-005bcdc3-a3e3-4e86-af98-1f803bb02bdf service nova] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-0359bd09-2353-403f-9a16-6252324c87cf req-005bcdc3-a3e3-4e86-af98-1f803bb02bdf service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] No waiting events found dispatching network-vif-plugged-c9175401-a233-4208-989d-72f952608659 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:48:57 user nova-compute[74646]: WARNING nova.compute.manager [req-0359bd09-2353-403f-9a16-6252324c87cf req-005bcdc3-a3e3-4e86-af98-1f803bb02bdf service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Received unexpected event network-vif-plugged-c9175401-a233-4208-989d-72f952608659 for instance with vm_state building and task_state spawning.
Oct 26 15:48:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-0359bd09-2353-403f-9a16-6252324c87cf req-005bcdc3-a3e3-4e86-af98-1f803bb02bdf service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Received event network-vif-plugged-c9175401-a233-4208-989d-72f952608659 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0359bd09-2353-403f-9a16-6252324c87cf req-005bcdc3-a3e3-4e86-af98-1f803bb02bdf service nova] Acquiring lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0359bd09-2353-403f-9a16-6252324c87cf req-005bcdc3-a3e3-4e86-af98-1f803bb02bdf service nova] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0359bd09-2353-403f-9a16-6252324c87cf req-005bcdc3-a3e3-4e86-af98-1f803bb02bdf service nova] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-0359bd09-2353-403f-9a16-6252324c87cf req-005bcdc3-a3e3-4e86-af98-1f803bb02bdf service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] No waiting events found dispatching network-vif-plugged-c9175401-a233-4208-989d-72f952608659 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:48:57 user nova-compute[74646]: WARNING nova.compute.manager [req-0359bd09-2353-403f-9a16-6252324c87cf req-005bcdc3-a3e3-4e86-af98-1f803bb02bdf service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Received unexpected event network-vif-plugged-c9175401-a233-4208-989d-72f952608659 for instance with vm_state building and task_state spawning.
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.compute.manager [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:48:58 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Instance spawned successfully.
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:48:58 user nova-compute[74646]: INFO nova.compute.manager [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Took 7.85 seconds to spawn the instance on the hypervisor.
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.compute.manager [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Received event network-vif-plugged-529d94bf-3278-41ad-b2c1-522b68db2421 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] Acquiring lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] No waiting events found dispatching network-vif-plugged-529d94bf-3278-41ad-b2c1-522b68db2421 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:48:58 user nova-compute[74646]: WARNING nova.compute.manager [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Received unexpected event network-vif-plugged-529d94bf-3278-41ad-b2c1-522b68db2421 for instance with vm_state active and task_state None.
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Received event network-vif-plugged-2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] Acquiring lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] No waiting events found dispatching network-vif-plugged-2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:48:58 user nova-compute[74646]: WARNING nova.compute.manager [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Received unexpected event network-vif-plugged-2a89712c-1508-4385-941b-b8bea7de3c35 for instance with vm_state active and task_state None.
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Received event network-vif-plugged-2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] Acquiring lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] No waiting events found dispatching network-vif-plugged-2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:48:58 user nova-compute[74646]: WARNING nova.compute.manager [req-6b50e2aa-3153-40d1-83ae-9f876e63327d req-91933ac6-3030-4626-9303-d0d44fa6baf8 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Received unexpected event network-vif-plugged-2a89712c-1508-4385-941b-b8bea7de3c35 for instance with vm_state active and task_state None.
Oct 26 15:48:58 user nova-compute[74646]: INFO nova.compute.manager [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Took 8.82 seconds to build instance.
Oct 26 15:48:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-05f68d18-6b7f-4fb1-af1b-1f20000c69cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.060s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG nova.compute.manager [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:48:59 user nova-compute[74646]: INFO nova.compute.claims [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Claim successful on node user
Oct 26 15:48:59 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG nova.compute.manager [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG nova.compute.manager [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG nova.network.neutron [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:48:59 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:48:59 user nova-compute[74646]: DEBUG nova.compute.manager [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG nova.policy [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '723b9bbed73446b29f877a87c48234fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d636dad453466192a545f54098b6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG nova.compute.manager [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:48:59 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Creating image(s)
Oct 26 15:48:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:48:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.232s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:49:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:49:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.246s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk 1073741824" returned: 0 in 0.064s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.319s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:49:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.255s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:00 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:49:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:00 user nova-compute[74646]: DEBUG nova.network.neutron [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Successfully created port: c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Cannot resize image /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Ensure instance console log exists: /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG nova.network.neutron [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Successfully updated port: c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquired lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG nova.network.neutron [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-b53402b1-9e2a-4451-8ace-3bf0019b6f6f req-8508023a-696c-4dfe-acbc-6baa70eef48a service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received event network-changed-c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-b53402b1-9e2a-4451-8ace-3bf0019b6f6f req-8508023a-696c-4dfe-acbc-6baa70eef48a service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Refreshing instance network info cache due to event network-changed-c03623fa-065f-47ad-9127-5fdebf97a32d. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b53402b1-9e2a-4451-8ace-3bf0019b6f6f req-8508023a-696c-4dfe-acbc-6baa70eef48a service nova] Acquiring lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:49:01 user nova-compute[74646]: DEBUG nova.network.neutron [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.network.neutron [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Updating instance_info_cache with network_info: [{"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Releasing lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.compute.manager [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Instance network_info: |[{"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b53402b1-9e2a-4451-8ace-3bf0019b6f6f req-8508023a-696c-4dfe-acbc-6baa70eef48a service nova] Acquired lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.network.neutron [req-b53402b1-9e2a-4451-8ace-3bf0019b6f6f req-8508023a-696c-4dfe-acbc-6baa70eef48a service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Refreshing network info cache for port c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Start _get_guest_xml network_info=[{"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:49:02 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:49:02 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-109261951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-109261951',id=6,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORFY2BSLaMhq/E5p+UHLBw9zanVj3hPYzpAhpE2tuRkW9nT+9656pE9yOGjFfMafxl/9w7KQhKQ7j+X841AaJHigdfvo2GKz6ua9+kNxAcYmgo0FYMnOu5s42XAwkFHvw==',key_name='tempest-keypair-1091666697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2d636dad453466192a545f54098b6ef',ramdisk_id='',reservation_id='r-2mi45cco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-180887235',owner_user_name='tempest-TaggedAttachmentsTest-180887235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='723b9bbed73446b29f877a87c48234fe',uuid=8edad9e5-5649-4ac7-a885-ae2d85cfeafe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Converting VIF {"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d4:d9,bridge_name='br-int',has_traffic_filtering=True,id=c03623fa-065f-47ad-9127-5fdebf97a32d,network=Network(1886d1dd-4e6f-4725-b822-e4edeeeafe53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc03623fa-06') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.objects.instance [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lazy-loading 'pci_devices' on Instance uuid 8edad9e5-5649-4ac7-a885-ae2d85cfeafe {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:49:02 user nova-compute[74646]:   <uuid>8edad9e5-5649-4ac7-a885-ae2d85cfeafe</uuid>
Oct 26 15:49:02 user nova-compute[74646]:   <name>instance-00000006</name>
Oct 26 15:49:02 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:49:02 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:49:02 user nova-compute[74646]:   <metadata>
Oct 26 15:49:02 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:49:02 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:49:02 user nova-compute[74646]:       <nova:name>tempest-device-tagging-server-109261951</nova:name>
Oct 26 15:49:02 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:49:02</nova:creationTime>
Oct 26 15:49:02 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:49:02 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:49:02 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:49:02 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:49:02 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:49:02 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:49:02 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:49:02 user nova-compute[74646]:       <nova:owner>
Oct 26 15:49:02 user nova-compute[74646]:         <nova:user uuid="723b9bbed73446b29f877a87c48234fe">tempest-TaggedAttachmentsTest-180887235-project-member</nova:user>
Oct 26 15:49:02 user nova-compute[74646]:         <nova:project uuid="c2d636dad453466192a545f54098b6ef">tempest-TaggedAttachmentsTest-180887235</nova:project>
Oct 26 15:49:02 user nova-compute[74646]:       </nova:owner>
Oct 26 15:49:02 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:49:02 user nova-compute[74646]:       <nova:ports>
Oct 26 15:49:02 user nova-compute[74646]:         <nova:port uuid="c03623fa-065f-47ad-9127-5fdebf97a32d">
Oct 26 15:49:02 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 15:49:02 user nova-compute[74646]:         </nova:port>
Oct 26 15:49:02 user nova-compute[74646]:       </nova:ports>
Oct 26 15:49:02 user nova-compute[74646]:     </nova:instance>
Oct 26 15:49:02 user nova-compute[74646]:   </metadata>
Oct 26 15:49:02 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:49:02 user nova-compute[74646]:     <system>
Oct 26 15:49:02 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:49:02 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:49:02 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:49:02 user nova-compute[74646]:       <entry name="serial">8edad9e5-5649-4ac7-a885-ae2d85cfeafe</entry>
Oct 26 15:49:02 user nova-compute[74646]:       <entry name="uuid">8edad9e5-5649-4ac7-a885-ae2d85cfeafe</entry>
Oct 26 15:49:02 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:49:02 user nova-compute[74646]:     </system>
Oct 26 15:49:02 user nova-compute[74646]:   </sysinfo>
Oct 26 15:49:02 user nova-compute[74646]:   <os>
Oct 26 15:49:02 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:49:02 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:49:02 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:49:02 user nova-compute[74646]:   </os>
Oct 26 15:49:02 user nova-compute[74646]:   <features>
Oct 26 15:49:02 user nova-compute[74646]:     <acpi/>
Oct 26 15:49:02 user nova-compute[74646]:     <apic/>
Oct 26 15:49:02 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:49:02 user nova-compute[74646]:   </features>
Oct 26 15:49:02 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:49:02 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:49:02 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:49:02 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:49:02 user nova-compute[74646]:   </clock>
Oct 26 15:49:02 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:49:02 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:49:02 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:49:02 user nova-compute[74646]:   </cpu>
Oct 26 15:49:02 user nova-compute[74646]:   <devices>
Oct 26 15:49:02 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:49:02 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:49:02 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk"/>
Oct 26 15:49:02 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:49:02 user nova-compute[74646]:     </disk>
Oct 26 15:49:02 user nova-compute[74646]:     <disk type="file" device="cdrom">
Oct 26 15:49:02 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 15:49:02 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk.config"/>
Oct 26 15:49:02 user nova-compute[74646]:       <target dev="hda" bus="ide"/>
Oct 26 15:49:02 user nova-compute[74646]:     </disk>
Oct 26 15:49:02 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:49:02 user nova-compute[74646]:       <mac address="fa:16:3e:e2:d4:d9"/>
Oct 26 15:49:02 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:49:02 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:49:02 user nova-compute[74646]:       <target dev="tapc03623fa-06"/>
Oct 26 15:49:02 user nova-compute[74646]:     </interface>
Oct 26 15:49:02 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:49:02 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/console.log" append="off"/>
Oct 26 15:49:02 user nova-compute[74646]:     </serial>
Oct 26 15:49:02 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:49:02 user nova-compute[74646]:     <video>
Oct 26 15:49:02 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:49:02 user nova-compute[74646]:     </video>
Oct 26 15:49:02 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:49:02 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:49:02 user nova-compute[74646]:     </rng>
Oct 26 15:49:02 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:49:02 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:49:02 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:49:02 user nova-compute[74646]:     </memballoon>
Oct 26 15:49:02 user nova-compute[74646]:   </devices>
Oct 26 15:49:02 user nova-compute[74646]: </domain>
Oct 26 15:49:02 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-109261951',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-109261951',id=6,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORFY2BSLaMhq/E5p+UHLBw9zanVj3hPYzpAhpE2tuRkW9nT+9656pE9yOGjFfMafxl/9w7KQhKQ7j+X841AaJHigdfvo2GKz6ua9+kNxAcYmgo0FYMnOu5s42XAwkFHvw==',key_name='tempest-keypair-1091666697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c2d636dad453466192a545f54098b6ef',ramdisk_id='',reservation_id='r-2mi45cco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-180887235',owner_user_name='tempest-TaggedAttachmentsTest-180887235-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:49:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='723b9bbed73446b29f877a87c48234fe',uuid=8edad9e5-5649-4ac7-a885-ae2d85cfeafe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Converting VIF {"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d4:d9,bridge_name='br-int',has_traffic_filtering=True,id=c03623fa-065f-47ad-9127-5fdebf97a32d,network=Network(1886d1dd-4e6f-4725-b822-e4edeeeafe53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc03623fa-06') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG os_vif [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d4:d9,bridge_name='br-int',has_traffic_filtering=True,id=c03623fa-065f-47ad-9127-5fdebf97a32d,network=Network(1886d1dd-4e6f-4725-b822-e4edeeeafe53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc03623fa-06') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e14626af-729f-5cf0-b4ea-b62beddccb99', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc03623fa-06, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc03623fa-06, col_values=(('qos', UUID('95fd8f61-a9ba-403f-87af-2a74e796e63a')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc03623fa-06, col_values=(('external_ids', {'iface-id': 'c03623fa-065f-47ad-9127-5fdebf97a32d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:d4:d9', 'vm-uuid': '8edad9e5-5649-4ac7-a885-ae2d85cfeafe'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:02 user nova-compute[74646]: INFO os_vif [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:d4:d9,bridge_name='br-int',has_traffic_filtering=True,id=c03623fa-065f-47ad-9127-5fdebf97a32d,network=Network(1886d1dd-4e6f-4725-b822-e4edeeeafe53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc03623fa-06')
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] No BDM found with device name hda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] No VIF found with MAC fa:16:3e:e2:d4:d9, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:49:02 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Using config drive
Oct 26 15:49:02 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Creating config drive at /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk.config
Oct 26 15:49:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxlc9evy0 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxlc9evy0" returned: 0 in 0.071s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.network.neutron [req-b53402b1-9e2a-4451-8ace-3bf0019b6f6f req-8508023a-696c-4dfe-acbc-6baa70eef48a service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Updated VIF entry in instance network info cache for port c03623fa-065f-47ad-9127-5fdebf97a32d. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG nova.network.neutron [req-b53402b1-9e2a-4451-8ace-3bf0019b6f6f req-8508023a-696c-4dfe-acbc-6baa70eef48a service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Updating instance_info_cache with network_info: [{"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:49:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b53402b1-9e2a-4451-8ace-3bf0019b6f6f req-8508023a-696c-4dfe-acbc-6baa70eef48a service nova] Releasing lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:49:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:04 user nova-compute[74646]: DEBUG nova.compute.manager [req-2dfb70c3-1f83-4920-91b6-5affbd1f42e6 req-101be9be-2b58-4038-9ab1-567d4b210f3a service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received event network-vif-plugged-c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:49:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2dfb70c3-1f83-4920-91b6-5affbd1f42e6 req-101be9be-2b58-4038-9ab1-567d4b210f3a service nova] Acquiring lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:49:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2dfb70c3-1f83-4920-91b6-5affbd1f42e6 req-101be9be-2b58-4038-9ab1-567d4b210f3a service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:49:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2dfb70c3-1f83-4920-91b6-5affbd1f42e6 req-101be9be-2b58-4038-9ab1-567d4b210f3a service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:49:04 user nova-compute[74646]: DEBUG nova.compute.manager [req-2dfb70c3-1f83-4920-91b6-5affbd1f42e6 req-101be9be-2b58-4038-9ab1-567d4b210f3a service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] No waiting events found dispatching network-vif-plugged-c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:49:04 user nova-compute[74646]: WARNING nova.compute.manager [req-2dfb70c3-1f83-4920-91b6-5affbd1f42e6 req-101be9be-2b58-4038-9ab1-567d4b210f3a service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received unexpected event network-vif-plugged-c03623fa-065f-47ad-9127-5fdebf97a32d for instance with vm_state building and task_state spawning.
Oct 26 15:49:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-dbab56ae-403f-48bf-9ddb-d1120d018d0c req-2b86123b-e23e-45ac-aabd-081668bd1562 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received event network-vif-plugged-c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:49:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dbab56ae-403f-48bf-9ddb-d1120d018d0c req-2b86123b-e23e-45ac-aabd-081668bd1562 service nova] Acquiring lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:49:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dbab56ae-403f-48bf-9ddb-d1120d018d0c req-2b86123b-e23e-45ac-aabd-081668bd1562 service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:49:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dbab56ae-403f-48bf-9ddb-d1120d018d0c req-2b86123b-e23e-45ac-aabd-081668bd1562 service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:49:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-dbab56ae-403f-48bf-9ddb-d1120d018d0c req-2b86123b-e23e-45ac-aabd-081668bd1562 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] No waiting events found dispatching network-vif-plugged-c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:49:06 user nova-compute[74646]: WARNING nova.compute.manager [req-dbab56ae-403f-48bf-9ddb-d1120d018d0c req-2b86123b-e23e-45ac-aabd-081668bd1562 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received unexpected event network-vif-plugged-c03623fa-065f-47ad-9127-5fdebf97a32d for instance with vm_state building and task_state spawning.
Oct 26 15:49:06 user nova-compute[74646]: DEBUG nova.compute.manager [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:49:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:49:06 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Instance spawned successfully.
Oct 26 15:49:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:49:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:49:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:49:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:49:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:49:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:49:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:49:06 user nova-compute[74646]: INFO nova.compute.manager [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Took 6.83 seconds to spawn the instance on the hypervisor.
Oct 26 15:49:06 user nova-compute[74646]: DEBUG nova.compute.manager [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:49:06 user nova-compute[74646]: INFO nova.compute.manager [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Took 7.74 seconds to build instance.
Oct 26 15:49:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-83cb9b7f-e056-4f73-b5c4-a637d07a36e2 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.886s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:49:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:08 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:49:08 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Cleaning up deleted instances {{(pid=74646) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 15:49:08 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] There are 0 instances to clean {{(pid=74646) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 15:49:08 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:49:08 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Cleaning up deleted instances with incomplete migration  {{(pid=74646) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 15:49:08 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:49:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:49:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:49:08 user nova-compute[74646]: DEBUG nova.compute.manager [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:49:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:49:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:49:08 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:49:08 user nova-compute[74646]: INFO nova.compute.claims [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Claim successful on node user
Oct 26 15:49:09 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.402s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG nova.network.neutron [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:49:09 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:49:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG nova.policy [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72a2d301a6a74de5be38e9b31c87fa26', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '796b5380a64145f0985b670b051a47d9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:49:09 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Creating image(s)
Oct 26 15:49:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "/opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "/opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.195s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.197s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk 1073741824" returned: 0 in 0.138s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG nova.network.neutron [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Successfully created port: 9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.193s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Cannot resize image /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Ensure instance console log exists: /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:49:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Successfully updated port: 9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "refresh_cache-b8a97889-399d-46ec-ac9a-8d2db324ce69" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquired lock "refresh_cache-b8a97889-399d-46ec-ac9a-8d2db324ce69" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.compute.manager [req-513a70eb-f412-434d-9c98-c9bc66edf881 req-95827aee-63c4-4d43-96ad-4689a37d9d19 service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Received event network-changed-9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.compute.manager [req-513a70eb-f412-434d-9c98-c9bc66edf881 req-95827aee-63c4-4d43-96ad-4689a37d9d19 service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Refreshing instance network info cache due to event network-changed-9c1652a6-3a41-44b7-8c28-52dcbbf07212. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-513a70eb-f412-434d-9c98-c9bc66edf881 req-95827aee-63c4-4d43-96ad-4689a37d9d19 service nova] Acquiring lock "refresh_cache-b8a97889-399d-46ec-ac9a-8d2db324ce69" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Updating instance_info_cache with network_info: [{"id": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "address": "fa:16:3e:a7:f3:71", "network": {"id": "1ed7e661-ac84-4aab-8f25-02ffc06fbd62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-461114934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796b5380a64145f0985b670b051a47d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1652a6-3a", "ovs_interfaceid": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Releasing lock "refresh_cache-b8a97889-399d-46ec-ac9a-8d2db324ce69" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Instance network_info: |[{"id": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "address": "fa:16:3e:a7:f3:71", "network": {"id": "1ed7e661-ac84-4aab-8f25-02ffc06fbd62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-461114934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796b5380a64145f0985b670b051a47d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1652a6-3a", "ovs_interfaceid": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-513a70eb-f412-434d-9c98-c9bc66edf881 req-95827aee-63c4-4d43-96ad-4689a37d9d19 service nova] Acquired lock "refresh_cache-b8a97889-399d-46ec-ac9a-8d2db324ce69" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.network.neutron [req-513a70eb-f412-434d-9c98-c9bc66edf881 req-95827aee-63c4-4d43-96ad-4689a37d9d19 service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Refreshing network info cache for port 9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Start _get_guest_xml network_info=[{"id": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "address": "fa:16:3e:a7:f3:71", "network": {"id": "1ed7e661-ac84-4aab-8f25-02ffc06fbd62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-461114934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796b5380a64145f0985b670b051a47d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1652a6-3a", "ovs_interfaceid": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:49:11 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:49:11 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1095028569',display_name='tempest-TestVolumeSwap-server-1095028569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1095028569',id=7,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHx82WVz4hG9BbgLFDLFCM6ebksOzi/Glt7d9bYFhR7k3NYtXWIpCjSMit8JL6ERcT4WHhLVsaGX1g6cdwqvs1B7ymhC9t8YE7mYoQjBd/kqlvyggbnB73FUTa5UjU2TQA==',key_name='tempest-keypair-315809944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='796b5380a64145f0985b670b051a47d9',ramdisk_id='',reservation_id='r-c1pja9r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-485599319',owner_user_name='tempest-TestVolumeSwap-485599319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a2d301a6a74de5be38e9b31c87fa26',uuid=b8a97889-399d-46ec-ac9a-8d2db324ce69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "address": "fa:16:3e:a7:f3:71", "network": {"id": "1ed7e661-ac84-4aab-8f25-02ffc06fbd62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-461114934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796b5380a64145f0985b670b051a47d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1652a6-3a", "ovs_interfaceid": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Converting VIF {"id": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "address": "fa:16:3e:a7:f3:71", "network": {"id": "1ed7e661-ac84-4aab-8f25-02ffc06fbd62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-461114934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796b5380a64145f0985b670b051a47d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1652a6-3a", "ovs_interfaceid": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f3:71,bridge_name='br-int',has_traffic_filtering=True,id=9c1652a6-3a41-44b7-8c28-52dcbbf07212,network=Network(1ed7e661-ac84-4aab-8f25-02ffc06fbd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1652a6-3a') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.objects.instance [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lazy-loading 'pci_devices' on Instance uuid b8a97889-399d-46ec-ac9a-8d2db324ce69 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:49:11 user nova-compute[74646]:   <uuid>b8a97889-399d-46ec-ac9a-8d2db324ce69</uuid>
Oct 26 15:49:11 user nova-compute[74646]:   <name>instance-00000007</name>
Oct 26 15:49:11 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:49:11 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:49:11 user nova-compute[74646]:   <metadata>
Oct 26 15:49:11 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:49:11 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:49:11 user nova-compute[74646]:       <nova:name>tempest-TestVolumeSwap-server-1095028569</nova:name>
Oct 26 15:49:11 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:49:11</nova:creationTime>
Oct 26 15:49:11 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:49:11 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:49:11 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:49:11 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:49:11 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:49:11 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:49:11 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:49:11 user nova-compute[74646]:       <nova:owner>
Oct 26 15:49:11 user nova-compute[74646]:         <nova:user uuid="72a2d301a6a74de5be38e9b31c87fa26">tempest-TestVolumeSwap-485599319-project-member</nova:user>
Oct 26 15:49:11 user nova-compute[74646]:         <nova:project uuid="796b5380a64145f0985b670b051a47d9">tempest-TestVolumeSwap-485599319</nova:project>
Oct 26 15:49:11 user nova-compute[74646]:       </nova:owner>
Oct 26 15:49:11 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:49:11 user nova-compute[74646]:       <nova:ports>
Oct 26 15:49:11 user nova-compute[74646]:         <nova:port uuid="9c1652a6-3a41-44b7-8c28-52dcbbf07212">
Oct 26 15:49:11 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 15:49:11 user nova-compute[74646]:         </nova:port>
Oct 26 15:49:11 user nova-compute[74646]:       </nova:ports>
Oct 26 15:49:11 user nova-compute[74646]:     </nova:instance>
Oct 26 15:49:11 user nova-compute[74646]:   </metadata>
Oct 26 15:49:11 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:49:11 user nova-compute[74646]:     <system>
Oct 26 15:49:11 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:49:11 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:49:11 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:49:11 user nova-compute[74646]:       <entry name="serial">b8a97889-399d-46ec-ac9a-8d2db324ce69</entry>
Oct 26 15:49:11 user nova-compute[74646]:       <entry name="uuid">b8a97889-399d-46ec-ac9a-8d2db324ce69</entry>
Oct 26 15:49:11 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:49:11 user nova-compute[74646]:     </system>
Oct 26 15:49:11 user nova-compute[74646]:   </sysinfo>
Oct 26 15:49:11 user nova-compute[74646]:   <os>
Oct 26 15:49:11 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:49:11 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:49:11 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:49:11 user nova-compute[74646]:   </os>
Oct 26 15:49:11 user nova-compute[74646]:   <features>
Oct 26 15:49:11 user nova-compute[74646]:     <acpi/>
Oct 26 15:49:11 user nova-compute[74646]:     <apic/>
Oct 26 15:49:11 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:49:11 user nova-compute[74646]:   </features>
Oct 26 15:49:11 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:49:11 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:49:11 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:49:11 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:49:11 user nova-compute[74646]:   </clock>
Oct 26 15:49:11 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:49:11 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:49:11 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:49:11 user nova-compute[74646]:   </cpu>
Oct 26 15:49:11 user nova-compute[74646]:   <devices>
Oct 26 15:49:11 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:49:11 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:49:11 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk"/>
Oct 26 15:49:11 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:49:11 user nova-compute[74646]:     </disk>
Oct 26 15:49:11 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:49:11 user nova-compute[74646]:       <mac address="fa:16:3e:a7:f3:71"/>
Oct 26 15:49:11 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:49:11 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:49:11 user nova-compute[74646]:       <target dev="tap9c1652a6-3a"/>
Oct 26 15:49:11 user nova-compute[74646]:     </interface>
Oct 26 15:49:11 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:49:11 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/console.log" append="off"/>
Oct 26 15:49:11 user nova-compute[74646]:     </serial>
Oct 26 15:49:11 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:49:11 user nova-compute[74646]:     <video>
Oct 26 15:49:11 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:49:11 user nova-compute[74646]:     </video>
Oct 26 15:49:11 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:49:11 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:49:11 user nova-compute[74646]:     </rng>
Oct 26 15:49:11 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:49:11 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:49:11 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:49:11 user nova-compute[74646]:     </memballoon>
Oct 26 15:49:11 user nova-compute[74646]:   </devices>
Oct 26 15:49:11 user nova-compute[74646]: </domain>
Oct 26 15:49:11 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1095028569',display_name='tempest-TestVolumeSwap-server-1095028569',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1095028569',id=7,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHx82WVz4hG9BbgLFDLFCM6ebksOzi/Glt7d9bYFhR7k3NYtXWIpCjSMit8JL6ERcT4WHhLVsaGX1g6cdwqvs1B7ymhC9t8YE7mYoQjBd/kqlvyggbnB73FUTa5UjU2TQA==',key_name='tempest-keypair-315809944',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='796b5380a64145f0985b670b051a47d9',ramdisk_id='',reservation_id='r-c1pja9r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-485599319',owner_user_name='tempest-TestVolumeSwap-485599319-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:49:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a2d301a6a74de5be38e9b31c87fa26',uuid=b8a97889-399d-46ec-ac9a-8d2db324ce69,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "address": "fa:16:3e:a7:f3:71", "network": {"id": "1ed7e661-ac84-4aab-8f25-02ffc06fbd62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-461114934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796b5380a64145f0985b670b051a47d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1652a6-3a", "ovs_interfaceid": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Converting VIF {"id": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "address": "fa:16:3e:a7:f3:71", "network": {"id": "1ed7e661-ac84-4aab-8f25-02ffc06fbd62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-461114934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796b5380a64145f0985b670b051a47d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1652a6-3a", "ovs_interfaceid": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f3:71,bridge_name='br-int',has_traffic_filtering=True,id=9c1652a6-3a41-44b7-8c28-52dcbbf07212,network=Network(1ed7e661-ac84-4aab-8f25-02ffc06fbd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1652a6-3a') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG os_vif [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f3:71,bridge_name='br-int',has_traffic_filtering=True,id=9c1652a6-3a41-44b7-8c28-52dcbbf07212,network=Network(1ed7e661-ac84-4aab-8f25-02ffc06fbd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1652a6-3a') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '87976c9c-d908-5ee9-a5fd-334e8e225462', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9c1652a6-3a, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9c1652a6-3a, col_values=(('qos', UUID('8c7e086b-b394-45a9-82c0-5d548ab9afa0')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9c1652a6-3a, col_values=(('external_ids', {'iface-id': '9c1652a6-3a41-44b7-8c28-52dcbbf07212', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:f3:71', 'vm-uuid': 'b8a97889-399d-46ec-ac9a-8d2db324ce69'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:11 user nova-compute[74646]: INFO os_vif [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:f3:71,bridge_name='br-int',has_traffic_filtering=True,id=9c1652a6-3a41-44b7-8c28-52dcbbf07212,network=Network(1ed7e661-ac84-4aab-8f25-02ffc06fbd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1652a6-3a')
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:49:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] No VIF found with MAC fa:16:3e:a7:f3:71, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:49:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-513a70eb-f412-434d-9c98-c9bc66edf881 req-95827aee-63c4-4d43-96ad-4689a37d9d19 service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Updated VIF entry in instance network info cache for port 9c1652a6-3a41-44b7-8c28-52dcbbf07212. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:49:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-513a70eb-f412-434d-9c98-c9bc66edf881 req-95827aee-63c4-4d43-96ad-4689a37d9d19 service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Updating instance_info_cache with network_info: [{"id": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "address": "fa:16:3e:a7:f3:71", "network": {"id": "1ed7e661-ac84-4aab-8f25-02ffc06fbd62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-461114934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796b5380a64145f0985b670b051a47d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1652a6-3a", "ovs_interfaceid": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:49:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-513a70eb-f412-434d-9c98-c9bc66edf881 req-95827aee-63c4-4d43-96ad-4689a37d9d19 service nova] Releasing lock "refresh_cache-b8a97889-399d-46ec-ac9a-8d2db324ce69" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:49:12 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Rebuilding the list of instances to heal {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Skipping network cache update for instance because it is Building. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG nova.compute.manager [req-afe5744e-db48-45c8-91fb-928522843303 req-8e628bc9-becc-4a8b-b9ab-c47661fed841 service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Received event network-vif-plugged-9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-afe5744e-db48-45c8-91fb-928522843303 req-8e628bc9-becc-4a8b-b9ab-c47661fed841 service nova] Acquiring lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-afe5744e-db48-45c8-91fb-928522843303 req-8e628bc9-becc-4a8b-b9ab-c47661fed841 service nova] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-afe5744e-db48-45c8-91fb-928522843303 req-8e628bc9-becc-4a8b-b9ab-c47661fed841 service nova] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG nova.compute.manager [req-afe5744e-db48-45c8-91fb-928522843303 req-8e628bc9-becc-4a8b-b9ab-c47661fed841 service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] No waiting events found dispatching network-vif-plugged-9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:49:13 user nova-compute[74646]: WARNING nova.compute.manager [req-afe5744e-db48-45c8-91fb-928522843303 req-8e628bc9-becc-4a8b-b9ab-c47661fed841 service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Received unexpected event network-vif-plugged-9c1652a6-3a41-44b7-8c28-52dcbbf07212 for instance with vm_state building and task_state spawning.
Oct 26 15:49:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 15:49:13 user nova-compute[74646]: DEBUG nova.objects.instance [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lazy-loading 'info_cache' on Instance uuid 1c5d5313-72f0-4f49-83b7-f277d5da4191 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:49:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:14 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Updating instance_info_cache with network_info: [{"id": "529d94bf-3278-41ad-b2c1-522b68db2421", "address": "fa:16:3e:2e:e2:50", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529d94bf-32", "ovs_interfaceid": "529d94bf-3278-41ad-b2c1-522b68db2421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:49:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:49:14 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 15:49:14 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:49:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:49:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:49:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:49:14 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:49:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:49:15 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Instance spawned successfully.
Oct 26 15:49:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:49:15 user nova-compute[74646]: INFO nova.compute.manager [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Took 6.00 seconds to spawn the instance on the hypervisor.
Oct 26 15:49:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-95aa4a1d-1afe-4cbf-b99e-14d116962d3c req-04675ccb-8e12-4dc5-8b0d-5d365acff49d service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Received event network-vif-plugged-9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-95aa4a1d-1afe-4cbf-b99e-14d116962d3c req-04675ccb-8e12-4dc5-8b0d-5d365acff49d service nova] Acquiring lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-95aa4a1d-1afe-4cbf-b99e-14d116962d3c req-04675ccb-8e12-4dc5-8b0d-5d365acff49d service nova] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-95aa4a1d-1afe-4cbf-b99e-14d116962d3c req-04675ccb-8e12-4dc5-8b0d-5d365acff49d service nova] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-95aa4a1d-1afe-4cbf-b99e-14d116962d3c req-04675ccb-8e12-4dc5-8b0d-5d365acff49d service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] No waiting events found dispatching network-vif-plugged-9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:49:15 user nova-compute[74646]: WARNING nova.compute.manager [req-95aa4a1d-1afe-4cbf-b99e-14d116962d3c req-04675ccb-8e12-4dc5-8b0d-5d365acff49d service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Received unexpected event network-vif-plugged-9c1652a6-3a41-44b7-8c28-52dcbbf07212 for instance with vm_state building and task_state spawning.
Oct 26 15:49:15 user nova-compute[74646]: INFO nova.compute.manager [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Took 6.90 seconds to build instance.
Oct 26 15:49:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-38d929db-cf64-490f-9e2b-23823f06622c tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:49:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:49:19 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:49:19 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7811MB free_disk=25.716270446777344GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1c5d5313-72f0-4f49-83b7-f277d5da4191 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 5e42f38e-e10f-43b7-89ab-ab22addfcf95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 042a78ac-e95b-45ae-8a9f-9fc0be22881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 0c76f879-d140-484b-89ed-8d4012f44a7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance be9a6bab-6958-43bb-9ed8-a531e05ed98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b8a97889-399d-46ec-ac9a-8d2db324ce69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing inventories for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Updating ProviderTree inventory for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Updating inventory in ProviderTree for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing aggregate associations for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6, aggregates: None {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing trait associations for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 15:49:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:20 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:49:20 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:49:20 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:49:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.922s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:49:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:49:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:50:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:50:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 15:50:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 15:50:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 15:50:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "5cb074cb-b061-4b25-baef-230f5198313c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "5cb074cb-b061-4b25-baef-230f5198313c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:50:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:09 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:50:09 user nova-compute[74646]: INFO nova.compute.claims [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Claim successful on node user
Oct 26 15:50:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.425s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:50:10 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:50:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG nova.policy [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9c53fa7260a54cee97a07bc12f78144e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9743ac2f5304819835c4f369c376e31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:50:10 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Creating image(s)
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "/opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "/opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "/opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.259s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.187s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk 1073741824" returned: 0 in 0.052s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-b9ae0be8-048a-4077-8e59-95314ad72fa8 req-57b0d9ff-993c-46fe-827c-81b77cd41a1c service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Received event network-changed-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-b9ae0be8-048a-4077-8e59-95314ad72fa8 req-57b0d9ff-993c-46fe-827c-81b77cd41a1c service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Refreshing instance network info cache due to event network-changed-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b9ae0be8-048a-4077-8e59-95314ad72fa8 req-57b0d9ff-993c-46fe-827c-81b77cd41a1c service nova] Acquiring lock "refresh_cache-5e42f38e-e10f-43b7-89ab-ab22addfcf95" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b9ae0be8-048a-4077-8e59-95314ad72fa8 req-57b0d9ff-993c-46fe-827c-81b77cd41a1c service nova] Acquired lock "refresh_cache-5e42f38e-e10f-43b7-89ab-ab22addfcf95" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG nova.network.neutron [req-b9ae0be8-048a-4077-8e59-95314ad72fa8 req-57b0d9ff-993c-46fe-827c-81b77cd41a1c service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Refreshing network info cache for port e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:50:10 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Successfully created port: 2ea9dd30-122d-4046-9664-026972d57759 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.216s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Cannot resize image /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Ensure instance console log exists: /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Successfully updated port: 2ea9dd30-122d-4046-9664-026972d57759 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "refresh_cache-5cb074cb-b061-4b25-baef-230f5198313c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquired lock "refresh_cache-5cb074cb-b061-4b25-baef-230f5198313c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG nova.compute.manager [req-a495bf1c-1185-491e-8d62-b379c1a4a25f req-6f7f7c1e-9b55-43e6-a380-b6aeb1f9d133 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Received event network-changed-2ea9dd30-122d-4046-9664-026972d57759 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG nova.compute.manager [req-a495bf1c-1185-491e-8d62-b379c1a4a25f req-6f7f7c1e-9b55-43e6-a380-b6aeb1f9d133 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Refreshing instance network info cache due to event network-changed-2ea9dd30-122d-4046-9664-026972d57759. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a495bf1c-1185-491e-8d62-b379c1a4a25f req-6f7f7c1e-9b55-43e6-a380-b6aeb1f9d133 service nova] Acquiring lock "refresh_cache-5cb074cb-b061-4b25-baef-230f5198313c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG nova.network.neutron [req-b9ae0be8-048a-4077-8e59-95314ad72fa8 req-57b0d9ff-993c-46fe-827c-81b77cd41a1c service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Updated VIF entry in instance network info cache for port e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG nova.network.neutron [req-b9ae0be8-048a-4077-8e59-95314ad72fa8 req-57b0d9ff-993c-46fe-827c-81b77cd41a1c service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Updating instance_info_cache with network_info: [{"id": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "address": "fa:16:3e:81:8c:c3", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59d9ca3-b8", "ovs_interfaceid": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b9ae0be8-048a-4077-8e59-95314ad72fa8 req-57b0d9ff-993c-46fe-827c-81b77cd41a1c service nova] Releasing lock "refresh_cache-5e42f38e-e10f-43b7-89ab-ab22addfcf95" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:50:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Updating instance_info_cache with network_info: [{"id": "2ea9dd30-122d-4046-9664-026972d57759", "address": "fa:16:3e:e0:c8:e5", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea9dd30-12", "ovs_interfaceid": "2ea9dd30-122d-4046-9664-026972d57759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Releasing lock "refresh_cache-5cb074cb-b061-4b25-baef-230f5198313c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Instance network_info: |[{"id": "2ea9dd30-122d-4046-9664-026972d57759", "address": "fa:16:3e:e0:c8:e5", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea9dd30-12", "ovs_interfaceid": "2ea9dd30-122d-4046-9664-026972d57759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a495bf1c-1185-491e-8d62-b379c1a4a25f req-6f7f7c1e-9b55-43e6-a380-b6aeb1f9d133 service nova] Acquired lock "refresh_cache-5cb074cb-b061-4b25-baef-230f5198313c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-a495bf1c-1185-491e-8d62-b379c1a4a25f req-6f7f7c1e-9b55-43e6-a380-b6aeb1f9d133 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Refreshing network info cache for port 2ea9dd30-122d-4046-9664-026972d57759 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Start _get_guest_xml network_info=[{"id": "2ea9dd30-122d-4046-9664-026972d57759", "address": "fa:16:3e:e0:c8:e5", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea9dd30-12", "ovs_interfaceid": "2ea9dd30-122d-4046-9664-026972d57759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:50:12 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:50:12 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1614563322',display_name='tempest-ServersNegativeTestJSON-server-1614563322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1614563322',id=8,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9743ac2f5304819835c4f369c376e31',ramdisk_id='',reservation_id='r-k4epadeg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-986135927',owner_user_name='tempest-ServersNegativeTestJSON-986135927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:50:10Z,user_data=None,user_id='9c53fa7260a54cee97a07bc12f78144e',uuid=5cb074cb-b061-4b25-baef-230f5198313c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ea9dd30-122d-4046-9664-026972d57759", "address": "fa:16:3e:e0:c8:e5", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea9dd30-12", "ovs_interfaceid": "2ea9dd30-122d-4046-9664-026972d57759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Converting VIF {"id": "2ea9dd30-122d-4046-9664-026972d57759", "address": "fa:16:3e:e0:c8:e5", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea9dd30-12", "ovs_interfaceid": "2ea9dd30-122d-4046-9664-026972d57759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c8:e5,bridge_name='br-int',has_traffic_filtering=True,id=2ea9dd30-122d-4046-9664-026972d57759,network=Network(553f3b75-4be8-40fa-a771-51ae8487bd58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea9dd30-12') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.objects.instance [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lazy-loading 'pci_devices' on Instance uuid 5cb074cb-b061-4b25-baef-230f5198313c {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:50:12 user nova-compute[74646]:   <uuid>5cb074cb-b061-4b25-baef-230f5198313c</uuid>
Oct 26 15:50:12 user nova-compute[74646]:   <name>instance-00000008</name>
Oct 26 15:50:12 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:50:12 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:50:12 user nova-compute[74646]:   <metadata>
Oct 26 15:50:12 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:50:12 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:50:12 user nova-compute[74646]:       <nova:name>tempest-ServersNegativeTestJSON-server-1614563322</nova:name>
Oct 26 15:50:12 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:50:12</nova:creationTime>
Oct 26 15:50:12 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:50:12 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:50:12 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:50:12 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:50:12 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:50:12 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:50:12 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:50:12 user nova-compute[74646]:       <nova:owner>
Oct 26 15:50:12 user nova-compute[74646]:         <nova:user uuid="9c53fa7260a54cee97a07bc12f78144e">tempest-ServersNegativeTestJSON-986135927-project-member</nova:user>
Oct 26 15:50:12 user nova-compute[74646]:         <nova:project uuid="e9743ac2f5304819835c4f369c376e31">tempest-ServersNegativeTestJSON-986135927</nova:project>
Oct 26 15:50:12 user nova-compute[74646]:       </nova:owner>
Oct 26 15:50:12 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:50:12 user nova-compute[74646]:       <nova:ports>
Oct 26 15:50:12 user nova-compute[74646]:         <nova:port uuid="2ea9dd30-122d-4046-9664-026972d57759">
Oct 26 15:50:12 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 15:50:12 user nova-compute[74646]:         </nova:port>
Oct 26 15:50:12 user nova-compute[74646]:       </nova:ports>
Oct 26 15:50:12 user nova-compute[74646]:     </nova:instance>
Oct 26 15:50:12 user nova-compute[74646]:   </metadata>
Oct 26 15:50:12 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:50:12 user nova-compute[74646]:     <system>
Oct 26 15:50:12 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:50:12 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:50:12 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:50:12 user nova-compute[74646]:       <entry name="serial">5cb074cb-b061-4b25-baef-230f5198313c</entry>
Oct 26 15:50:12 user nova-compute[74646]:       <entry name="uuid">5cb074cb-b061-4b25-baef-230f5198313c</entry>
Oct 26 15:50:12 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:50:12 user nova-compute[74646]:     </system>
Oct 26 15:50:12 user nova-compute[74646]:   </sysinfo>
Oct 26 15:50:12 user nova-compute[74646]:   <os>
Oct 26 15:50:12 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:50:12 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:50:12 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:50:12 user nova-compute[74646]:   </os>
Oct 26 15:50:12 user nova-compute[74646]:   <features>
Oct 26 15:50:12 user nova-compute[74646]:     <acpi/>
Oct 26 15:50:12 user nova-compute[74646]:     <apic/>
Oct 26 15:50:12 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:50:12 user nova-compute[74646]:   </features>
Oct 26 15:50:12 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:50:12 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:50:12 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:50:12 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:50:12 user nova-compute[74646]:   </clock>
Oct 26 15:50:12 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:50:12 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:50:12 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:50:12 user nova-compute[74646]:   </cpu>
Oct 26 15:50:12 user nova-compute[74646]:   <devices>
Oct 26 15:50:12 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:50:12 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:50:12 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk"/>
Oct 26 15:50:12 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:50:12 user nova-compute[74646]:     </disk>
Oct 26 15:50:12 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:50:12 user nova-compute[74646]:       <mac address="fa:16:3e:e0:c8:e5"/>
Oct 26 15:50:12 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:50:12 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:50:12 user nova-compute[74646]:       <target dev="tap2ea9dd30-12"/>
Oct 26 15:50:12 user nova-compute[74646]:     </interface>
Oct 26 15:50:12 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:50:12 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/console.log" append="off"/>
Oct 26 15:50:12 user nova-compute[74646]:     </serial>
Oct 26 15:50:12 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:50:12 user nova-compute[74646]:     <video>
Oct 26 15:50:12 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:50:12 user nova-compute[74646]:     </video>
Oct 26 15:50:12 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:50:12 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:50:12 user nova-compute[74646]:     </rng>
Oct 26 15:50:12 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:50:12 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:50:12 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:50:12 user nova-compute[74646]:     </memballoon>
Oct 26 15:50:12 user nova-compute[74646]:   </devices>
Oct 26 15:50:12 user nova-compute[74646]: </domain>
Oct 26 15:50:12 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1614563322',display_name='tempest-ServersNegativeTestJSON-server-1614563322',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1614563322',id=8,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e9743ac2f5304819835c4f369c376e31',ramdisk_id='',reservation_id='r-k4epadeg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-986135927',owner_user_name='tempest-ServersNegativeTestJSON-986135927-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:50:10Z,user_data=None,user_id='9c53fa7260a54cee97a07bc12f78144e',uuid=5cb074cb-b061-4b25-baef-230f5198313c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2ea9dd30-122d-4046-9664-026972d57759", "address": "fa:16:3e:e0:c8:e5", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea9dd30-12", "ovs_interfaceid": "2ea9dd30-122d-4046-9664-026972d57759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Converting VIF {"id": "2ea9dd30-122d-4046-9664-026972d57759", "address": "fa:16:3e:e0:c8:e5", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea9dd30-12", "ovs_interfaceid": "2ea9dd30-122d-4046-9664-026972d57759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c8:e5,bridge_name='br-int',has_traffic_filtering=True,id=2ea9dd30-122d-4046-9664-026972d57759,network=Network(553f3b75-4be8-40fa-a771-51ae8487bd58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea9dd30-12') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG os_vif [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c8:e5,bridge_name='br-int',has_traffic_filtering=True,id=2ea9dd30-122d-4046-9664-026972d57759,network=Network(553f3b75-4be8-40fa-a771-51ae8487bd58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea9dd30-12') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a8a94be-f736-5d55-8099-e43b42d235fe', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2ea9dd30-12, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2ea9dd30-12, col_values=(('qos', UUID('2c12fff7-6176-4acf-a697-9a5b19040084')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2ea9dd30-12, col_values=(('external_ids', {'iface-id': '2ea9dd30-122d-4046-9664-026972d57759', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:c8:e5', 'vm-uuid': '5cb074cb-b061-4b25-baef-230f5198313c'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:12 user nova-compute[74646]: INFO os_vif [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c8:e5,bridge_name='br-int',has_traffic_filtering=True,id=2ea9dd30-122d-4046-9664-026972d57759,network=Network(553f3b75-4be8-40fa-a771-51ae8487bd58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea9dd30-12')
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] No VIF found with MAC fa:16:3e:e0:c8:e5, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-a495bf1c-1185-491e-8d62-b379c1a4a25f req-6f7f7c1e-9b55-43e6-a380-b6aeb1f9d133 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Updated VIF entry in instance network info cache for port 2ea9dd30-122d-4046-9664-026972d57759. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-a495bf1c-1185-491e-8d62-b379c1a4a25f req-6f7f7c1e-9b55-43e6-a380-b6aeb1f9d133 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Updating instance_info_cache with network_info: [{"id": "2ea9dd30-122d-4046-9664-026972d57759", "address": "fa:16:3e:e0:c8:e5", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea9dd30-12", "ovs_interfaceid": "2ea9dd30-122d-4046-9664-026972d57759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:50:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a495bf1c-1185-491e-8d62-b379c1a4a25f req-6f7f7c1e-9b55-43e6-a380-b6aeb1f9d133 service nova] Releasing lock "refresh_cache-5cb074cb-b061-4b25-baef-230f5198313c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:50:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:14 user nova-compute[74646]: DEBUG nova.compute.manager [req-6a4e15a4-b335-44e7-9066-eba154e116fc req-5f862d29-fb74-4510-9e65-76ba1ce41648 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Received event network-vif-plugged-2ea9dd30-122d-4046-9664-026972d57759 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:50:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6a4e15a4-b335-44e7-9066-eba154e116fc req-5f862d29-fb74-4510-9e65-76ba1ce41648 service nova] Acquiring lock "5cb074cb-b061-4b25-baef-230f5198313c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6a4e15a4-b335-44e7-9066-eba154e116fc req-5f862d29-fb74-4510-9e65-76ba1ce41648 service nova] Lock "5cb074cb-b061-4b25-baef-230f5198313c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6a4e15a4-b335-44e7-9066-eba154e116fc req-5f862d29-fb74-4510-9e65-76ba1ce41648 service nova] Lock "5cb074cb-b061-4b25-baef-230f5198313c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:14 user nova-compute[74646]: DEBUG nova.compute.manager [req-6a4e15a4-b335-44e7-9066-eba154e116fc req-5f862d29-fb74-4510-9e65-76ba1ce41648 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] No waiting events found dispatching network-vif-plugged-2ea9dd30-122d-4046-9664-026972d57759 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:50:14 user nova-compute[74646]: WARNING nova.compute.manager [req-6a4e15a4-b335-44e7-9066-eba154e116fc req-5f862d29-fb74-4510-9e65-76ba1ce41648 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Received unexpected event network-vif-plugged-2ea9dd30-122d-4046-9664-026972d57759 for instance with vm_state building and task_state spawning.
Oct 26 15:50:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:50:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:50:15 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Instance spawned successfully.
Oct 26 15:50:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:50:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:50:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:50:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:50:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:50:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:50:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:50:15 user nova-compute[74646]: INFO nova.compute.manager [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Took 5.53 seconds to spawn the instance on the hypervisor.
Oct 26 15:50:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:50:16 user nova-compute[74646]: INFO nova.compute.manager [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Took 6.33 seconds to build instance.
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2dc4e220-e44a-42cf-8282-387fe44524e5 tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "5cb074cb-b061-4b25-baef-230f5198313c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.433s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-5e42f38e-e10f-43b7-89ab-ab22addfcf95" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-5e42f38e-e10f-43b7-89ab-ab22addfcf95" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG nova.compute.manager [req-5f0f7bac-17df-4497-af76-03b19bbac4a5 req-e2c4013d-3c0a-4059-b3a3-72115a4e37b7 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Received event network-vif-plugged-2ea9dd30-122d-4046-9664-026972d57759 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5f0f7bac-17df-4497-af76-03b19bbac4a5 req-e2c4013d-3c0a-4059-b3a3-72115a4e37b7 service nova] Acquiring lock "5cb074cb-b061-4b25-baef-230f5198313c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5f0f7bac-17df-4497-af76-03b19bbac4a5 req-e2c4013d-3c0a-4059-b3a3-72115a4e37b7 service nova] Lock "5cb074cb-b061-4b25-baef-230f5198313c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5f0f7bac-17df-4497-af76-03b19bbac4a5 req-e2c4013d-3c0a-4059-b3a3-72115a4e37b7 service nova] Lock "5cb074cb-b061-4b25-baef-230f5198313c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG nova.compute.manager [req-5f0f7bac-17df-4497-af76-03b19bbac4a5 req-e2c4013d-3c0a-4059-b3a3-72115a4e37b7 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] No waiting events found dispatching network-vif-plugged-2ea9dd30-122d-4046-9664-026972d57759 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:50:16 user nova-compute[74646]: WARNING nova.compute.manager [req-5f0f7bac-17df-4497-af76-03b19bbac4a5 req-e2c4013d-3c0a-4059-b3a3-72115a4e37b7 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Received unexpected event network-vif-plugged-2ea9dd30-122d-4046-9664-026972d57759 for instance with vm_state active and task_state None.
Oct 26 15:50:16 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Updating instance_info_cache with network_info: [{"id": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "address": "fa:16:3e:81:8c:c3", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59d9ca3-b8", "ovs_interfaceid": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-5e42f38e-e10f-43b7-89ab-ab22addfcf95" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG nova.objects.instance [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lazy-loading 'flavor' on Instance uuid 5e42f38e-e10f-43b7-89ab-ab22addfcf95 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.004s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:16 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:50:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.154s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:17 user nova-compute[74646]: INFO nova.compute.manager [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Attaching volume 937a7311-8727-438a-903c-c15e5202437f to /dev/vdb
Oct 26 15:50:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:17 user nova-compute[74646]: DEBUG os_brick.utils [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:50:17 user nova-compute[74646]: INFO oslo.privsep.daemon [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp3_p8vug5/privsep.sock']
Oct 26 15:50:17 user sudo[85603]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp3_p8vug5/privsep.sock
Oct 26 15:50:17 user sudo[85603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 26 15:50:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:19 user sudo[85603]: pam_unix(sudo:session): session closed for user root
Oct 26 15:50:19 user nova-compute[74646]: INFO oslo.privsep.daemon [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Spawned new privsep daemon via rootwrap
Oct 26 15:50:19 user nova-compute[74646]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 26 15:50:19 user nova-compute[74646]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 26 15:50:19 user nova-compute[74646]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 26 15:50:19 user nova-compute[74646]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85624
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd8f285-b744-4ea4-87a7-2642d2f2e550]: (2,) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e33b48-1096-4cf7-a607-dab177c7ad6c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:19 user nova-compute[74646]: WARNING os_brick.initiator.connectors.nvmeof [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2371b64b-e936-48c0-acd8-28abb177f313]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e050078-d955-46a4-a5e2-8420209e10a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d6497b-7f1e-430a-956e-b1d84f949d9b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:50:19 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddfa64ca-f179-4194-a7b0-ede534b88590]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG os_brick.utils [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] <== get_connector_properties: return (2057ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Updating existing volume attachment record: b95cf1b1-ba57-47dd-b40c-d24da1c27339 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:21 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:50:21 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:50:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7776MB free_disk=25.652545928955078GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1c5d5313-72f0-4f49-83b7-f277d5da4191 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 5e42f38e-e10f-43b7-89ab-ab22addfcf95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 042a78ac-e95b-45ae-8a9f-9fc0be22881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 0c76f879-d140-484b-89ed-8d4012f44a7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance be9a6bab-6958-43bb-9ed8-a531e05ed98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b8a97889-399d-46ec-ac9a-8d2db324ce69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 5cb074cb-b061-4b25-baef-230f5198313c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:50:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.539s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquiring lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG nova.objects.instance [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lazy-loading 'flavor' on Instance uuid 042a78ac-e95b-45ae-8a9f-9fc0be22881c {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquiring lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:23 user nova-compute[74646]: INFO nova.compute.manager [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Attaching volume 5934d9eb-f0d1-4686-a7cb-f1e937e03901 to /dev/vdb
Oct 26 15:50:23 user nova-compute[74646]: DEBUG os_brick.utils [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e82a40-8c14-4194-bb6e-450206c05151]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf87fc9a-3634-40c1-a00d-0f97ccffd791]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[000d409b-83d0-4d9e-84ae-b8165b28702f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c42734d-e3bb-43e9-b92d-91e7ec299aaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:50:23 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:50:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[063e963b-63f5-4030-9658-2c34abaab8aa]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG os_brick.utils [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:50:23 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Updating existing volume attachment record: 6c68f92c-314e-4e5e-a1ac-cf946833eb67 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:50:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:50:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:50:29 user nova-compute[74646]: INFO nova.compute.claims [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Claim successful on node user
Oct 26 15:50:29 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:50:29 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:50:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:50:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:50:29 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:50:29 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:50:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG nova.policy [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41bb4004c8444824bb91ff40a872c7cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9073433dc0b34618b5c52f010e49400e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:50:30 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Creating image(s)
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "/opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "/opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.200s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG nova.compute.manager [req-932a0008-acb2-4d73-b9fe-52f752096218 req-59a3be0d-abed-49cd-aef5-1753541fda55 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Received event network-changed-2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG nova.compute.manager [req-932a0008-acb2-4d73-b9fe-52f752096218 req-59a3be0d-abed-49cd-aef5-1753541fda55 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Refreshing instance network info cache due to event network-changed-2a89712c-1508-4385-941b-b8bea7de3c35. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-932a0008-acb2-4d73-b9fe-52f752096218 req-59a3be0d-abed-49cd-aef5-1753541fda55 service nova] Acquiring lock "refresh_cache-0c76f879-d140-484b-89ed-8d4012f44a7f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-932a0008-acb2-4d73-b9fe-52f752096218 req-59a3be0d-abed-49cd-aef5-1753541fda55 service nova] Acquired lock "refresh_cache-0c76f879-d140-484b-89ed-8d4012f44a7f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG nova.network.neutron [req-932a0008-acb2-4d73-b9fe-52f752096218 req-59a3be0d-abed-49cd-aef5-1753541fda55 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Refreshing network info cache for port 2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.218s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk 1073741824" returned: 0 in 0.073s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.299s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Successfully created port: c3fe6baa-9489-4801-a5cc-06b98d0f98f2 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.204s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:50:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.network.neutron [req-932a0008-acb2-4d73-b9fe-52f752096218 req-59a3be0d-abed-49cd-aef5-1753541fda55 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Updated VIF entry in instance network info cache for port 2a89712c-1508-4385-941b-b8bea7de3c35. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.network.neutron [req-932a0008-acb2-4d73-b9fe-52f752096218 req-59a3be0d-abed-49cd-aef5-1753541fda55 service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Updating instance_info_cache with network_info: [{"id": "2a89712c-1508-4385-941b-b8bea7de3c35", "address": "fa:16:3e:51:bc:da", "network": {"id": "99cf3989-5b18-4c8f-82f2-719e0019fe32", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-341987946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8efc31ce8cd746c2b17e13aee9014810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a89712c-15", "ovs_interfaceid": "2a89712c-1508-4385-941b-b8bea7de3c35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-932a0008-acb2-4d73-b9fe-52f752096218 req-59a3be0d-abed-49cd-aef5-1753541fda55 service nova] Releasing lock "refresh_cache-0c76f879-d140-484b-89ed-8d4012f44a7f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Cannot resize image /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Ensure instance console log exists: /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Successfully updated port: c3fe6baa-9489-4801-a5cc-06b98d0f98f2 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "refresh_cache-e8268040-8dbe-4320-94e9-f6cdaf4eb157" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquired lock "refresh_cache-e8268040-8dbe-4320-94e9-f6cdaf4eb157" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.compute.manager [req-1b2760fd-73e0-4b8c-8d5f-bdf7947cce65 req-37832505-fd85-4c47-90fb-566ffe400b29 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Received event network-changed-c3fe6baa-9489-4801-a5cc-06b98d0f98f2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.compute.manager [req-1b2760fd-73e0-4b8c-8d5f-bdf7947cce65 req-37832505-fd85-4c47-90fb-566ffe400b29 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Refreshing instance network info cache due to event network-changed-c3fe6baa-9489-4801-a5cc-06b98d0f98f2. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1b2760fd-73e0-4b8c-8d5f-bdf7947cce65 req-37832505-fd85-4c47-90fb-566ffe400b29 service nova] Acquiring lock "refresh_cache-e8268040-8dbe-4320-94e9-f6cdaf4eb157" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Updating instance_info_cache with network_info: [{"id": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "address": "fa:16:3e:b5:0c:58", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fe6baa-94", "ovs_interfaceid": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Releasing lock "refresh_cache-e8268040-8dbe-4320-94e9-f6cdaf4eb157" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Instance network_info: |[{"id": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "address": "fa:16:3e:b5:0c:58", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fe6baa-94", "ovs_interfaceid": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1b2760fd-73e0-4b8c-8d5f-bdf7947cce65 req-37832505-fd85-4c47-90fb-566ffe400b29 service nova] Acquired lock "refresh_cache-e8268040-8dbe-4320-94e9-f6cdaf4eb157" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.network.neutron [req-1b2760fd-73e0-4b8c-8d5f-bdf7947cce65 req-37832505-fd85-4c47-90fb-566ffe400b29 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Refreshing network info cache for port c3fe6baa-9489-4801-a5cc-06b98d0f98f2 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Start _get_guest_xml network_info=[{"id": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "address": "fa:16:3e:b5:0c:58", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fe6baa-94", "ovs_interfaceid": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:50:31 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:50:31 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-555869499',display_name='tempest-VolumesActionsTest-instance-555869499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-555869499',id=9,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9073433dc0b34618b5c52f010e49400e',ramdisk_id='',reservation_id='r-zeyd0qb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1225783245',owner_user_name='tempest-VolumesActionsTest-1225783245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:50:30Z,user_data=None,user_id='41bb4004c8444824bb91ff40a872c7cd',uuid=e8268040-8dbe-4320-94e9-f6cdaf4eb157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "address": "fa:16:3e:b5:0c:58", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fe6baa-94", "ovs_interfaceid": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Converting VIF {"id": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "address": "fa:16:3e:b5:0c:58", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fe6baa-94", "ovs_interfaceid": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0c:58,bridge_name='br-int',has_traffic_filtering=True,id=c3fe6baa-9489-4801-a5cc-06b98d0f98f2,network=Network(fdc4cebd-c95f-4365-86a0-09b4b4a847b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fe6baa-94') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.objects.instance [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lazy-loading 'pci_devices' on Instance uuid e8268040-8dbe-4320-94e9-f6cdaf4eb157 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:50:31 user nova-compute[74646]:   <uuid>e8268040-8dbe-4320-94e9-f6cdaf4eb157</uuid>
Oct 26 15:50:31 user nova-compute[74646]:   <name>instance-00000009</name>
Oct 26 15:50:31 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:50:31 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:50:31 user nova-compute[74646]:   <metadata>
Oct 26 15:50:31 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:50:31 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:50:31 user nova-compute[74646]:       <nova:name>tempest-VolumesActionsTest-instance-555869499</nova:name>
Oct 26 15:50:31 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:50:31</nova:creationTime>
Oct 26 15:50:31 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:50:31 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:50:31 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:50:31 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:50:31 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:50:31 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:50:31 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:50:31 user nova-compute[74646]:       <nova:owner>
Oct 26 15:50:31 user nova-compute[74646]:         <nova:user uuid="41bb4004c8444824bb91ff40a872c7cd">tempest-VolumesActionsTest-1225783245-project-member</nova:user>
Oct 26 15:50:31 user nova-compute[74646]:         <nova:project uuid="9073433dc0b34618b5c52f010e49400e">tempest-VolumesActionsTest-1225783245</nova:project>
Oct 26 15:50:31 user nova-compute[74646]:       </nova:owner>
Oct 26 15:50:31 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:50:31 user nova-compute[74646]:       <nova:ports>
Oct 26 15:50:31 user nova-compute[74646]:         <nova:port uuid="c3fe6baa-9489-4801-a5cc-06b98d0f98f2">
Oct 26 15:50:31 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 15:50:31 user nova-compute[74646]:         </nova:port>
Oct 26 15:50:31 user nova-compute[74646]:       </nova:ports>
Oct 26 15:50:31 user nova-compute[74646]:     </nova:instance>
Oct 26 15:50:31 user nova-compute[74646]:   </metadata>
Oct 26 15:50:31 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:50:31 user nova-compute[74646]:     <system>
Oct 26 15:50:31 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:50:31 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:50:31 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:50:31 user nova-compute[74646]:       <entry name="serial">e8268040-8dbe-4320-94e9-f6cdaf4eb157</entry>
Oct 26 15:50:31 user nova-compute[74646]:       <entry name="uuid">e8268040-8dbe-4320-94e9-f6cdaf4eb157</entry>
Oct 26 15:50:31 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:50:31 user nova-compute[74646]:     </system>
Oct 26 15:50:31 user nova-compute[74646]:   </sysinfo>
Oct 26 15:50:31 user nova-compute[74646]:   <os>
Oct 26 15:50:31 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:50:31 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:50:31 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:50:31 user nova-compute[74646]:   </os>
Oct 26 15:50:31 user nova-compute[74646]:   <features>
Oct 26 15:50:31 user nova-compute[74646]:     <acpi/>
Oct 26 15:50:31 user nova-compute[74646]:     <apic/>
Oct 26 15:50:31 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:50:31 user nova-compute[74646]:   </features>
Oct 26 15:50:31 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:50:31 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:50:31 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:50:31 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:50:31 user nova-compute[74646]:   </clock>
Oct 26 15:50:31 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:50:31 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:50:31 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:50:31 user nova-compute[74646]:   </cpu>
Oct 26 15:50:31 user nova-compute[74646]:   <devices>
Oct 26 15:50:31 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:50:31 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:50:31 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk"/>
Oct 26 15:50:31 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:50:31 user nova-compute[74646]:     </disk>
Oct 26 15:50:31 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:50:31 user nova-compute[74646]:       <mac address="fa:16:3e:b5:0c:58"/>
Oct 26 15:50:31 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:50:31 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:50:31 user nova-compute[74646]:       <target dev="tapc3fe6baa-94"/>
Oct 26 15:50:31 user nova-compute[74646]:     </interface>
Oct 26 15:50:31 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:50:31 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/console.log" append="off"/>
Oct 26 15:50:31 user nova-compute[74646]:     </serial>
Oct 26 15:50:31 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:50:31 user nova-compute[74646]:     <video>
Oct 26 15:50:31 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:50:31 user nova-compute[74646]:     </video>
Oct 26 15:50:31 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:50:31 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:50:31 user nova-compute[74646]:     </rng>
Oct 26 15:50:31 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:50:31 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:50:31 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:50:31 user nova-compute[74646]:     </memballoon>
Oct 26 15:50:31 user nova-compute[74646]:   </devices>
Oct 26 15:50:31 user nova-compute[74646]: </domain>
Oct 26 15:50:31 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-555869499',display_name='tempest-VolumesActionsTest-instance-555869499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-555869499',id=9,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9073433dc0b34618b5c52f010e49400e',ramdisk_id='',reservation_id='r-zeyd0qb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1225783245',owner_user_name='tempest-VolumesActionsTest-1225783245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:50:30Z,user_data=None,user_id='41bb4004c8444824bb91ff40a872c7cd',uuid=e8268040-8dbe-4320-94e9-f6cdaf4eb157,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "address": "fa:16:3e:b5:0c:58", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fe6baa-94", "ovs_interfaceid": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Converting VIF {"id": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "address": "fa:16:3e:b5:0c:58", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fe6baa-94", "ovs_interfaceid": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0c:58,bridge_name='br-int',has_traffic_filtering=True,id=c3fe6baa-9489-4801-a5cc-06b98d0f98f2,network=Network(fdc4cebd-c95f-4365-86a0-09b4b4a847b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fe6baa-94') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG os_vif [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0c:58,bridge_name='br-int',has_traffic_filtering=True,id=c3fe6baa-9489-4801-a5cc-06b98d0f98f2,network=Network(fdc4cebd-c95f-4365-86a0-09b4b4a847b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fe6baa-94') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a0248d9f-5775-5056-ab1b-ebf1e9d5acda', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3fe6baa-94, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3fe6baa-94, col_values=(('qos', UUID('3db00a37-f297-433c-a264-7521c008e939')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3fe6baa-94, col_values=(('external_ids', {'iface-id': 'c3fe6baa-9489-4801-a5cc-06b98d0f98f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:0c:58', 'vm-uuid': 'e8268040-8dbe-4320-94e9-f6cdaf4eb157'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:31 user nova-compute[74646]: INFO os_vif [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0c:58,bridge_name='br-int',has_traffic_filtering=True,id=c3fe6baa-9489-4801-a5cc-06b98d0f98f2,network=Network(fdc4cebd-c95f-4365-86a0-09b4b4a847b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fe6baa-94')
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:50:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] No VIF found with MAC fa:16:3e:b5:0c:58, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:50:32 user nova-compute[74646]: DEBUG nova.network.neutron [req-1b2760fd-73e0-4b8c-8d5f-bdf7947cce65 req-37832505-fd85-4c47-90fb-566ffe400b29 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Updated VIF entry in instance network info cache for port c3fe6baa-9489-4801-a5cc-06b98d0f98f2. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:50:32 user nova-compute[74646]: DEBUG nova.network.neutron [req-1b2760fd-73e0-4b8c-8d5f-bdf7947cce65 req-37832505-fd85-4c47-90fb-566ffe400b29 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Updating instance_info_cache with network_info: [{"id": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "address": "fa:16:3e:b5:0c:58", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fe6baa-94", "ovs_interfaceid": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:50:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1b2760fd-73e0-4b8c-8d5f-bdf7947cce65 req-37832505-fd85-4c47-90fb-566ffe400b29 service nova] Releasing lock "refresh_cache-e8268040-8dbe-4320-94e9-f6cdaf4eb157" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:50:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-f03424fe-595f-47b5-9b13-ab0a7c885f55 req-d97f12e1-629d-413b-b418-ff5af2205a06 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Received event network-vif-plugged-c3fe6baa-9489-4801-a5cc-06b98d0f98f2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:50:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f03424fe-595f-47b5-9b13-ab0a7c885f55 req-d97f12e1-629d-413b-b418-ff5af2205a06 service nova] Acquiring lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f03424fe-595f-47b5-9b13-ab0a7c885f55 req-d97f12e1-629d-413b-b418-ff5af2205a06 service nova] Lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f03424fe-595f-47b5-9b13-ab0a7c885f55 req-d97f12e1-629d-413b-b418-ff5af2205a06 service nova] Lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-f03424fe-595f-47b5-9b13-ab0a7c885f55 req-d97f12e1-629d-413b-b418-ff5af2205a06 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] No waiting events found dispatching network-vif-plugged-c3fe6baa-9489-4801-a5cc-06b98d0f98f2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:50:33 user nova-compute[74646]: WARNING nova.compute.manager [req-f03424fe-595f-47b5-9b13-ab0a7c885f55 req-d97f12e1-629d-413b-b418-ff5af2205a06 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Received unexpected event network-vif-plugged-c3fe6baa-9489-4801-a5cc-06b98d0f98f2 for instance with vm_state building and task_state spawning.
Oct 26 15:50:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.volume.cinder [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Update attachment failed for attachment b95cf1b1-ba57-47dd-b40c-d24da1c27339. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4ceadacb-6065-4113-b1b6-bae88a5cb84c) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4ceadacb-6065-4113-b1b6-bae88a5cb84c)
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Failed to attach 937a7311-8727-438a-903c-c15e5202437f at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4ceadacb-6065-4113-b1b6-bae88a5cb84c)
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Traceback (most recent call last):
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     ret_val = method(obj, context, *args, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     self._do_attach(context, instance, volume, volume_api,
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     self._volume_attach(context, volume, connector, instance,
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     connection_info = volume_api.attachment_update(
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     res = method(self, ctx, *args, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     with excutils.save_and_reraise_exception():
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     self.force_reraise()
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     raise self.value
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     return method.func(obj, *args, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     resp = self._update('/attachments/%s' % id, body)
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     return self.request(url, method, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95]     raise exceptions.from_response(resp, body)
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4ceadacb-6065-4113-b1b6-bae88a5cb84c)
Oct 26 15:50:35 user nova-compute[74646]: ERROR nova.compute.manager [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] 
Oct 26 15:50:35 user nova-compute[74646]: DEBUG nova.compute.manager [req-029b2572-a175-45a3-a612-4c71823d0417 req-74fc96d1-c8de-40d2-bc1e-71e3a2d7aec1 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Received event network-vif-plugged-c3fe6baa-9489-4801-a5cc-06b98d0f98f2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:50:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-029b2572-a175-45a3-a612-4c71823d0417 req-74fc96d1-c8de-40d2-bc1e-71e3a2d7aec1 service nova] Acquiring lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-029b2572-a175-45a3-a612-4c71823d0417 req-74fc96d1-c8de-40d2-bc1e-71e3a2d7aec1 service nova] Lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-029b2572-a175-45a3-a612-4c71823d0417 req-74fc96d1-c8de-40d2-bc1e-71e3a2d7aec1 service nova] Lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:35 user nova-compute[74646]: DEBUG nova.compute.manager [req-029b2572-a175-45a3-a612-4c71823d0417 req-74fc96d1-c8de-40d2-bc1e-71e3a2d7aec1 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] No waiting events found dispatching network-vif-plugged-c3fe6baa-9489-4801-a5cc-06b98d0f98f2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:50:35 user nova-compute[74646]: WARNING nova.compute.manager [req-029b2572-a175-45a3-a612-4c71823d0417 req-74fc96d1-c8de-40d2-bc1e-71e3a2d7aec1 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Received unexpected event network-vif-plugged-c3fe6baa-9489-4801-a5cc-06b98d0f98f2 for instance with vm_state building and task_state spawning.
Oct 26 15:50:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.239s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:50:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:50:35 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Instance spawned successfully.
Oct 26 15:50:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server [None req-68613fc9-0471-4b2e-872f-a2f6b3c986ae tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4ceadacb-6065-4113-b1b6-bae88a5cb84c)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4ceadacb-6065-4113-b1b6-bae88a5cb84c)
Oct 26 15:50:35 user nova-compute[74646]: ERROR oslo_messaging.rpc.server 
Oct 26 15:50:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:50:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:50:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:50:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:50:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:50:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:50:35 user nova-compute[74646]: INFO nova.compute.manager [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Took 5.60 seconds to spawn the instance on the hypervisor.
Oct 26 15:50:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:50:35 user nova-compute[74646]: INFO nova.compute.manager [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Took 6.50 seconds to build instance.
Oct 26 15:50:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6953bc1-f3cb-459a-9758-7fca0ac08f93 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.599s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-0554cad9-ddc9-424a-9462-aeee1a9d1203 req-64996abc-1f67-4690-ba9d-27b7c1cf6b9b service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Received event network-changed-c9175401-a233-4208-989d-72f952608659 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:50:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-0554cad9-ddc9-424a-9462-aeee1a9d1203 req-64996abc-1f67-4690-ba9d-27b7c1cf6b9b service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Refreshing instance network info cache due to event network-changed-c9175401-a233-4208-989d-72f952608659. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:50:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0554cad9-ddc9-424a-9462-aeee1a9d1203 req-64996abc-1f67-4690-ba9d-27b7c1cf6b9b service nova] Acquiring lock "refresh_cache-be9a6bab-6958-43bb-9ed8-a531e05ed98d" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:50:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0554cad9-ddc9-424a-9462-aeee1a9d1203 req-64996abc-1f67-4690-ba9d-27b7c1cf6b9b service nova] Acquired lock "refresh_cache-be9a6bab-6958-43bb-9ed8-a531e05ed98d" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:50:40 user nova-compute[74646]: DEBUG nova.network.neutron [req-0554cad9-ddc9-424a-9462-aeee1a9d1203 req-64996abc-1f67-4690-ba9d-27b7c1cf6b9b service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Refreshing network info cache for port c9175401-a233-4208-989d-72f952608659 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:50:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Acquiring lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:40 user nova-compute[74646]: DEBUG nova.objects.instance [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lazy-loading 'flavor' on Instance uuid be9a6bab-6958-43bb-9ed8-a531e05ed98d {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:50:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.119s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:40 user nova-compute[74646]: DEBUG nova.network.neutron [req-0554cad9-ddc9-424a-9462-aeee1a9d1203 req-64996abc-1f67-4690-ba9d-27b7c1cf6b9b service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Updated VIF entry in instance network info cache for port c9175401-a233-4208-989d-72f952608659. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:50:40 user nova-compute[74646]: DEBUG nova.network.neutron [req-0554cad9-ddc9-424a-9462-aeee1a9d1203 req-64996abc-1f67-4690-ba9d-27b7c1cf6b9b service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Updating instance_info_cache with network_info: [{"id": "c9175401-a233-4208-989d-72f952608659", "address": "fa:16:3e:4e:a7:bf", "network": {"id": "f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702566873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9be77f8e6c0f4a21beabacb7a88f3d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9175401-a2", "ovs_interfaceid": "c9175401-a233-4208-989d-72f952608659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:50:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0554cad9-ddc9-424a-9462-aeee1a9d1203 req-64996abc-1f67-4690-ba9d-27b7c1cf6b9b service nova] Releasing lock "refresh_cache-be9a6bab-6958-43bb-9ed8-a531e05ed98d" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Acquiring lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:41 user nova-compute[74646]: INFO nova.compute.manager [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Attaching volume 3c3a665e-e29e-4a87-80e3-de831a1943a4 to /dev/vdb
Oct 26 15:50:41 user nova-compute[74646]: DEBUG os_brick.utils [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6287f53a-eee0-4380-8adc-a84ba4b1f332]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa2d68f-bde3-4ee0-9490-7f8594a27fba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[02913367-8dbd-4054-b5df-867271ba3927]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5bc706-a100-4a76-91ec-45cb244d6ee4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:50:41 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:50:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c76e8c6-f3f4-46ef-b5e8-f132ba2b0c64]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG os_brick.utils [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Updating existing volume attachment record: 80b8d004-e5e6-4a16-9cf3-d5af52baf967 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:50:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-4fe579c4-048e-472c-b7ef-83bee032a68c req-172cf53f-051a-4f0f-ae7c-34ebc1c44016 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received event network-changed-c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-4fe579c4-048e-472c-b7ef-83bee032a68c req-172cf53f-051a-4f0f-ae7c-34ebc1c44016 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Refreshing instance network info cache due to event network-changed-c03623fa-065f-47ad-9127-5fdebf97a32d. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4fe579c4-048e-472c-b7ef-83bee032a68c req-172cf53f-051a-4f0f-ae7c-34ebc1c44016 service nova] Acquiring lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4fe579c4-048e-472c-b7ef-83bee032a68c req-172cf53f-051a-4f0f-ae7c-34ebc1c44016 service nova] Acquired lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG nova.network.neutron [req-4fe579c4-048e-472c-b7ef-83bee032a68c req-172cf53f-051a-4f0f-ae7c-34ebc1c44016 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Refreshing network info cache for port c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "interface-8edad9e5-5649-4ac7-a885-ae2d85cfeafe-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "interface-8edad9e5-5649-4ac7-a885-ae2d85cfeafe-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG nova.objects.instance [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lazy-loading 'flavor' on Instance uuid 8edad9e5-5649-4ac7-a885-ae2d85cfeafe {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG nova.network.neutron [req-4fe579c4-048e-472c-b7ef-83bee032a68c req-172cf53f-051a-4f0f-ae7c-34ebc1c44016 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Updated VIF entry in instance network info cache for port c03623fa-065f-47ad-9127-5fdebf97a32d. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG nova.network.neutron [req-4fe579c4-048e-472c-b7ef-83bee032a68c req-172cf53f-051a-4f0f-ae7c-34ebc1c44016 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Updating instance_info_cache with network_info: [{"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4fe579c4-048e-472c-b7ef-83bee032a68c req-172cf53f-051a-4f0f-ae7c-34ebc1c44016 service nova] Releasing lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG nova.objects.instance [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lazy-loading 'pci_requests' on Instance uuid 8edad9e5-5649-4ac7-a885-ae2d85cfeafe {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG nova.objects.base [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Object Instance<8edad9e5-5649-4ac7-a885-ae2d85cfeafe> lazy-loaded attributes: flavor,pci_requests {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:50:50 user nova-compute[74646]: DEBUG nova.policy [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '723b9bbed73446b29f877a87c48234fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c2d636dad453466192a545f54098b6ef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:50:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:52 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Successfully created port: 80bebc53-31f0-4b1e-8abb-50bf65fdbc16 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:50:52 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Successfully updated port: 80bebc53-31f0-4b1e-8abb-50bf65fdbc16 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:50:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:50:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquired lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:50:52 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:50:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-ece6be2a-a1b2-459a-a8ac-907e99dcb580 req-2e4cbee6-65f7-49da-ab0e-939ee8136f26 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received event network-changed-80bebc53-31f0-4b1e-8abb-50bf65fdbc16 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:50:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-ece6be2a-a1b2-459a-a8ac-907e99dcb580 req-2e4cbee6-65f7-49da-ab0e-939ee8136f26 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Refreshing instance network info cache due to event network-changed-80bebc53-31f0-4b1e-8abb-50bf65fdbc16. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:50:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ece6be2a-a1b2-459a-a8ac-907e99dcb580 req-2e4cbee6-65f7-49da-ab0e-939ee8136f26 service nova] Acquiring lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Updating instance_info_cache with network_info: [{"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "address": "fa:16:3e:82:84:7f", "network": {"id": "8f104fed-08e3-4de9-b66a-7fe8c239c70f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2031322880", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bebc53-31", "ovs_interfaceid": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Releasing lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ece6be2a-a1b2-459a-a8ac-907e99dcb580 req-2e4cbee6-65f7-49da-ab0e-939ee8136f26 service nova] Acquired lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG nova.network.neutron [req-ece6be2a-a1b2-459a-a8ac-907e99dcb580 req-2e4cbee6-65f7-49da-ab0e-939ee8136f26 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Refreshing network info cache for port 80bebc53-31f0-4b1e-8abb-50bf65fdbc16 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-109261951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-109261951',id=6,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORFY2BSLaMhq/E5p+UHLBw9zanVj3hPYzpAhpE2tuRkW9nT+9656pE9yOGjFfMafxl/9w7KQhKQ7j+X841AaJHigdfvo2GKz6ua9+kNxAcYmgo0FYMnOu5s42XAwkFHvw==',key_name='tempest-keypair-1091666697',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2d636dad453466192a545f54098b6ef',ramdisk_id='',reservation_id='r-2mi45cco',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-180887235',owner_user_name='tempest-TaggedAttachmentsTest-180887235-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:49:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='723b9bbed73446b29f877a87c48234fe',uuid=8edad9e5-5649-4ac7-a885-ae2d85cfeafe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "address": "fa:16:3e:82:84:7f", "network": {"id": "8f104fed-08e3-4de9-b66a-7fe8c239c70f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2031322880", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bebc53-31", "ovs_interfaceid": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Converting VIF {"id": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "address": "fa:16:3e:82:84:7f", "network": {"id": "8f104fed-08e3-4de9-b66a-7fe8c239c70f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2031322880", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bebc53-31", "ovs_interfaceid": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7f,bridge_name='br-int',has_traffic_filtering=True,id=80bebc53-31f0-4b1e-8abb-50bf65fdbc16,network=Network(8f104fed-08e3-4de9-b66a-7fe8c239c70f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bebc53-31') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG os_vif [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7f,bridge_name='br-int',has_traffic_filtering=True,id=80bebc53-31f0-4b1e-8abb-50bf65fdbc16,network=Network(8f104fed-08e3-4de9-b66a-7fe8c239c70f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bebc53-31') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9dd95488-481f-5e8e-902d-342b7e321b87', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80bebc53-31, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80bebc53-31, col_values=(('qos', UUID('ac9cc936-04d5-4fc3-a741-8ba223c729a9')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80bebc53-31, col_values=(('external_ids', {'iface-id': '80bebc53-31f0-4b1e-8abb-50bf65fdbc16', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:84:7f', 'vm-uuid': '8edad9e5-5649-4ac7-a885-ae2d85cfeafe'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:53 user nova-compute[74646]: INFO os_vif [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7f,bridge_name='br-int',has_traffic_filtering=True,id=80bebc53-31f0-4b1e-8abb-50bf65fdbc16,network=Network(8f104fed-08e3-4de9-b66a-7fe8c239c70f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bebc53-31')
Oct 26 15:50:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-109261951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-109261951',id=6,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORFY2BSLaMhq/E5p+UHLBw9zanVj3hPYzpAhpE2tuRkW9nT+9656pE9yOGjFfMafxl/9w7KQhKQ7j+X841AaJHigdfvo2GKz6ua9+kNxAcYmgo0FYMnOu5s42XAwkFHvw==',key_name='tempest-keypair-1091666697',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c2d636dad453466192a545f54098b6ef',ramdisk_id='',reservation_id='r-2mi45cco',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-180887235',owner_user_name='tempest-TaggedAttachmentsTest-180887235-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:49:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='723b9bbed73446b29f877a87c48234fe',uuid=8edad9e5-5649-4ac7-a885-ae2d85cfeafe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "address": "fa:16:3e:82:84:7f", "network": {"id": "8f104fed-08e3-4de9-b66a-7fe8c239c70f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2031322880", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bebc53-31", "ovs_interfaceid": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Converting VIF {"id": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "address": "fa:16:3e:82:84:7f", "network": {"id": "8f104fed-08e3-4de9-b66a-7fe8c239c70f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2031322880", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bebc53-31", "ovs_interfaceid": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7f,bridge_name='br-int',has_traffic_filtering=True,id=80bebc53-31f0-4b1e-8abb-50bf65fdbc16,network=Network(8f104fed-08e3-4de9-b66a-7fe8c239c70f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bebc53-31') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] attach device xml: <interface type="ethernet">
Oct 26 15:50:53 user nova-compute[74646]:   <mac address="fa:16:3e:82:84:7f"/>
Oct 26 15:50:53 user nova-compute[74646]:   <model type="virtio"/>
Oct 26 15:50:53 user nova-compute[74646]:   <mtu size="1442"/>
Oct 26 15:50:53 user nova-compute[74646]:   <target dev="tap80bebc53-31"/>
Oct 26 15:50:53 user nova-compute[74646]: </interface>
Oct 26 15:50:53 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG nova.compute.manager [req-db05a093-df2a-48c1-9726-20f685602e55 req-d9be943a-9454-47ba-a8d6-0ba5b97d879b service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received event network-vif-plugged-80bebc53-31f0-4b1e-8abb-50bf65fdbc16 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-db05a093-df2a-48c1-9726-20f685602e55 req-d9be943a-9454-47ba-a8d6-0ba5b97d879b service nova] Acquiring lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-db05a093-df2a-48c1-9726-20f685602e55 req-d9be943a-9454-47ba-a8d6-0ba5b97d879b service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-db05a093-df2a-48c1-9726-20f685602e55 req-d9be943a-9454-47ba-a8d6-0ba5b97d879b service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG nova.compute.manager [req-db05a093-df2a-48c1-9726-20f685602e55 req-d9be943a-9454-47ba-a8d6-0ba5b97d879b service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] No waiting events found dispatching network-vif-plugged-80bebc53-31f0-4b1e-8abb-50bf65fdbc16 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:50:54 user nova-compute[74646]: WARNING nova.compute.manager [req-db05a093-df2a-48c1-9726-20f685602e55 req-d9be943a-9454-47ba-a8d6-0ba5b97d879b service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received unexpected event network-vif-plugged-80bebc53-31f0-4b1e-8abb-50bf65fdbc16 for instance with vm_state active and task_state None.
Oct 26 15:50:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] No BDM found with device name hda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] No VIF found with MAC fa:16:3e:e2:d4:d9, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:50:54 user nova-compute[74646]:   <nova:package version="0.0.0"/>
Oct 26 15:50:54 user nova-compute[74646]:   <nova:name>tempest-device-tagging-server-109261951</nova:name>
Oct 26 15:50:54 user nova-compute[74646]:   <nova:creationTime>2023-10-26 15:50:54</nova:creationTime>
Oct 26 15:50:54 user nova-compute[74646]:   <nova:flavor name="m1.tiny">
Oct 26 15:50:54 user nova-compute[74646]:     <nova:memory>512</nova:memory>
Oct 26 15:50:54 user nova-compute[74646]:     <nova:disk>1</nova:disk>
Oct 26 15:50:54 user nova-compute[74646]:     <nova:swap>0</nova:swap>
Oct 26 15:50:54 user nova-compute[74646]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:50:54 user nova-compute[74646]:     <nova:vcpus>1</nova:vcpus>
Oct 26 15:50:54 user nova-compute[74646]:   </nova:flavor>
Oct 26 15:50:54 user nova-compute[74646]:   <nova:owner>
Oct 26 15:50:54 user nova-compute[74646]:     <nova:user uuid="723b9bbed73446b29f877a87c48234fe">tempest-TaggedAttachmentsTest-180887235-project-member</nova:user>
Oct 26 15:50:54 user nova-compute[74646]:     <nova:project uuid="c2d636dad453466192a545f54098b6ef">tempest-TaggedAttachmentsTest-180887235</nova:project>
Oct 26 15:50:54 user nova-compute[74646]:   </nova:owner>
Oct 26 15:50:54 user nova-compute[74646]:   <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:50:54 user nova-compute[74646]:   <nova:ports>
Oct 26 15:50:54 user nova-compute[74646]:     <nova:port uuid="c03623fa-065f-47ad-9127-5fdebf97a32d">
Oct 26 15:50:54 user nova-compute[74646]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 15:50:54 user nova-compute[74646]:     </nova:port>
Oct 26 15:50:54 user nova-compute[74646]:     <nova:port uuid="80bebc53-31f0-4b1e-8abb-50bf65fdbc16">
Oct 26 15:50:54 user nova-compute[74646]:       <nova:ip type="fixed" address="10.10.10.215" ipVersion="4"/>
Oct 26 15:50:54 user nova-compute[74646]:     </nova:port>
Oct 26 15:50:54 user nova-compute[74646]:   </nova:ports>
Oct 26 15:50:54 user nova-compute[74646]: </nova:instance>
Oct 26 15:50:54 user nova-compute[74646]:  {{(pid=74646) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG nova.network.neutron [req-ece6be2a-a1b2-459a-a8ac-907e99dcb580 req-2e4cbee6-65f7-49da-ab0e-939ee8136f26 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Updated VIF entry in instance network info cache for port 80bebc53-31f0-4b1e-8abb-50bf65fdbc16. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG nova.network.neutron [req-ece6be2a-a1b2-459a-a8ac-907e99dcb580 req-2e4cbee6-65f7-49da-ab0e-939ee8136f26 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Updating instance_info_cache with network_info: [{"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "address": "fa:16:3e:82:84:7f", "network": {"id": "8f104fed-08e3-4de9-b66a-7fe8c239c70f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2031322880", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bebc53-31", "ovs_interfaceid": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ece6be2a-a1b2-459a-a8ac-907e99dcb580 req-2e4cbee6-65f7-49da-ab0e-939ee8136f26 service nova] Releasing lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2141186f-c6e8-4889-ab7e-edb8fad5e5f9 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "interface-8edad9e5-5649-4ac7-a885-ae2d85cfeafe-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.764s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG nova.objects.instance [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lazy-loading 'flavor' on Instance uuid 8edad9e5-5649-4ac7-a885-ae2d85cfeafe {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:55 user nova-compute[74646]: INFO nova.compute.manager [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Attaching volume e8f1e24c-2860-4389-b914-36c23bd904c0 to /dev/vdb
Oct 26 15:50:55 user nova-compute[74646]: DEBUG os_brick.utils [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15752a5-011d-4b82-8161-819502830957]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[565bab17-334e-4680-9c6f-99ff1ea0fea6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a78e391-2b35-40b1-9fa7-b2839432409f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2b5a25-fe67-4fbb-951a-abaa649cdd87]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:50:55 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:50:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fe5b86-7671-40bf-80f0-7d691a86e7bf]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG os_brick.utils [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:50:55 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Updating existing volume attachment record: 7363e78d-7661-4396-bc17-03f52b6eb380 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:50:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-c561b35e-40c5-4e2f-8539-2d469df33b45 req-23948c43-8b81-4bf7-ac4a-6ee06ac513b9 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received event network-vif-plugged-80bebc53-31f0-4b1e-8abb-50bf65fdbc16 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:50:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c561b35e-40c5-4e2f-8539-2d469df33b45 req-23948c43-8b81-4bf7-ac4a-6ee06ac513b9 service nova] Acquiring lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:50:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c561b35e-40c5-4e2f-8539-2d469df33b45 req-23948c43-8b81-4bf7-ac4a-6ee06ac513b9 service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:50:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c561b35e-40c5-4e2f-8539-2d469df33b45 req-23948c43-8b81-4bf7-ac4a-6ee06ac513b9 service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:50:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-c561b35e-40c5-4e2f-8539-2d469df33b45 req-23948c43-8b81-4bf7-ac4a-6ee06ac513b9 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] No waiting events found dispatching network-vif-plugged-80bebc53-31f0-4b1e-8abb-50bf65fdbc16 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:50:56 user nova-compute[74646]: WARNING nova.compute.manager [req-c561b35e-40c5-4e2f-8539-2d469df33b45 req-23948c43-8b81-4bf7-ac4a-6ee06ac513b9 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received unexpected event network-vif-plugged-80bebc53-31f0-4b1e-8abb-50bf65fdbc16 for instance with vm_state active and task_state None.
Oct 26 15:50:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:50:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-5e3f64b5-4546-477a-8e7c-39b5be45fda4 req-fed0db57-4593-4792-b44f-053cd2a99abe service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Received event network-changed-9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:50:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-5e3f64b5-4546-477a-8e7c-39b5be45fda4 req-fed0db57-4593-4792-b44f-053cd2a99abe service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Refreshing instance network info cache due to event network-changed-9c1652a6-3a41-44b7-8c28-52dcbbf07212. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:50:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5e3f64b5-4546-477a-8e7c-39b5be45fda4 req-fed0db57-4593-4792-b44f-053cd2a99abe service nova] Acquiring lock "refresh_cache-b8a97889-399d-46ec-ac9a-8d2db324ce69" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:50:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5e3f64b5-4546-477a-8e7c-39b5be45fda4 req-fed0db57-4593-4792-b44f-053cd2a99abe service nova] Acquired lock "refresh_cache-b8a97889-399d-46ec-ac9a-8d2db324ce69" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:50:59 user nova-compute[74646]: DEBUG nova.network.neutron [req-5e3f64b5-4546-477a-8e7c-39b5be45fda4 req-fed0db57-4593-4792-b44f-053cd2a99abe service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Refreshing network info cache for port 9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:50:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-5e3f64b5-4546-477a-8e7c-39b5be45fda4 req-fed0db57-4593-4792-b44f-053cd2a99abe service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Updated VIF entry in instance network info cache for port 9c1652a6-3a41-44b7-8c28-52dcbbf07212. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:51:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-5e3f64b5-4546-477a-8e7c-39b5be45fda4 req-fed0db57-4593-4792-b44f-053cd2a99abe service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Updating instance_info_cache with network_info: [{"id": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "address": "fa:16:3e:a7:f3:71", "network": {"id": "1ed7e661-ac84-4aab-8f25-02ffc06fbd62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-461114934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796b5380a64145f0985b670b051a47d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1652a6-3a", "ovs_interfaceid": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:51:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5e3f64b5-4546-477a-8e7c-39b5be45fda4 req-fed0db57-4593-4792-b44f-053cd2a99abe service nova] Releasing lock "refresh_cache-b8a97889-399d-46ec-ac9a-8d2db324ce69" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:51:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connector [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Factory for ISCSI on None {{(pid=74646) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwDrKaMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:51:14 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:51:14 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:51:14 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e26f811-5daa-4da4-9ffb-7004289c94f7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:51:14 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4327478-d000-454d-9a40-666540d2c2e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0] added
Oct 26 15:51:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5591ad83-a11e-403c-9e59-7b6c3ca37751]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec32112-f218-4610-942d-48f039dc9df6]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwDrKaMk {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PwDrKaMk" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f596164-9b17-4da9-8484-b8210b75684e]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PwDrKaMk'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[449f29db-788d-43c3-b380-250bbf58b272]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6edcff25-ad32-473b-a5ee-cc330dd9b946]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 15:51:14 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 15:51:14 user nova-compute[74646]:  {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:51:14 user nova-compute[74646]: WARNING os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 15:51:14 user nova-compute[74646]: 
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd8a798-859d-46c7-90f4-9537d8520f76]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0, portal: 172.16.0.220,3260]
Oct 26 15:51:14 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0, portal: 172.16.0.220,3260] successful.
Oct 26 15:51:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb9e3c6-6fcb-4523-800b-9f9b2ed5612c]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[22741773-a16a-4b36-9310-ffb8feb33b90]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.236s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[874c0cf2-9c80-4bed-9cec-f14132cc9bbb]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG nova.objects.instance [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lazy-loading 'flavor' on Instance uuid b8a97889-399d-46ec-ac9a-8d2db324ce69 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "0c76f879-d140-484b-89ed-8d4012f44a7f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:14 user nova-compute[74646]: DEBUG nova.objects.instance [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lazy-loading 'flavor' on Instance uuid 0c76f879-d140-484b-89ed-8d4012f44a7f {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:15 user nova-compute[74646]: INFO nova.compute.manager [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Attaching volume b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e to /dev/vdb
Oct 26 15:51:15 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwDrKaMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.266s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] <== connect_volume: return (1268ms) {'type': 'block', 'scsi_wwn': '23530336164646237', 'path': '/dev/sdb'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530336164646237', 'path': '/dev/sdb'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG nova.objects.instance [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lazy-loading 'flavor' on Instance uuid 8edad9e5-5649-4ac7-a885-ae2d85cfeafe {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 15:51:15 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:51:15 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 15:51:15 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:51:15 user nova-compute[74646]:   <serial>e8f1e24c-2860-4389-b914-36c23bd904c0</serial>
Oct 26 15:51:15 user nova-compute[74646]: </disk>
Oct 26 15:51:15 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "0c76f879-d140-484b-89ed-8d4012f44a7f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:15 user nova-compute[74646]: INFO nova.compute.manager [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Attaching volume c5a3b56c-4131-46b9-bd4c-d970c07c9931 to /dev/sdc
Oct 26 15:51:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] No BDM found with device name hda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] No VIF found with MAC fa:16:3e:e2:d4:d9, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG os_brick.utils [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4975942d-911d-4f38-944c-b29ec0cfa187]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0da37f9-7ae9-4a4a-a6fb-840b71be75ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8403f503-5215-46ee-8c84-2ccc5cb262f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c635a08a-1c74-4dcd-8ad1-20b4bedcdd34]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:51:16 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d884740-2cbd-44a5-b4fb-0c12b7dee552]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG os_brick.utils [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] <== get_connector_properties: return (217ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Updating existing volume attachment record: 6df2ccc0-10c9-49de-b139-36f98a15a330 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG os_brick.utils [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9886c7d4-f87b-40c3-927c-2e57f66e5ec0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[170d750f-b4a8-423f-9ce2-a0b155c8f344]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b89b24-fb80-42e5-9700-0f223f29583e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea85274-0c2c-43bf-9d3c-b07d3968387d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:51:16 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1f30b4-941a-4e85-8ac2-6a59d0be4476]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG os_brick.utils [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Updating existing volume attachment record: 570e51d7-8208-4db9-ba6b-7e1ec77a5439 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:51:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c284da2c-12e5-438b-9e13-8e69b147cd57 tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.263s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYqjuylE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:51:20 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:51:20 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:51:20 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2e0cf0-d4e6-4f3e-ad81-bc050a488773]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:51:20 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c069ac6d-e82a-4b18-8b80-b039ecb709f4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901] added
Oct 26 15:51:20 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c38897-c6f9-422c-b7f6-d5231432b054]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cea225a-ed1d-4a55-8bab-506d78ad8adf]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XYqjuylE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XYqjuylE" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c268bc21-5790-423a-811f-460a1f33aa55]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XYqjuylE'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c88775-65c4-49d0-991d-e5e440b2624b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[edad6797-7f9a-4aaa-8045-1d177cdc9e22]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:20 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:20 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f2506d-3963-4c24-8442-0186453892d6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901, portal: 172.16.0.220,3260]
Oct 26 15:51:20 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901, portal: 172.16.0.220,3260] successful.
Oct 26 15:51:20 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ad0094-4dde-486b-81fe-eca8d3092283]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9effbb-13a3-40b0-a29c-12df8a0d2f97]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:20 user nova-compute[74646]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 (non-flash)
Oct 26 15:51:20 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:20 user nova-compute[74646]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 (non-flash)
Oct 26 15:51:20 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f11d637-c291-4c48-9923-ed8caa66a456]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:51:20 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYqjuylE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:51:21 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:51:21 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23035333233656565', 'path': '/dev/sdc'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:51:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035333233656565', 'path': '/dev/sdc'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:51:21 user nova-compute[74646]: DEBUG nova.objects.instance [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lazy-loading 'flavor' on Instance uuid 042a78ac-e95b-45ae-8a9f-9fc0be22881c {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:51:21 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:51:21 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:51:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:51:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 15:51:21 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:51:21 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 15:51:21 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:51:21 user nova-compute[74646]:   <serial>5934d9eb-f0d1-4686-a7cb-f1e937e03901</serial>
Oct 26 15:51:21 user nova-compute[74646]: </disk>
Oct 26 15:51:21 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 15:51:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-042a78ac-e95b-45ae-8a9f-9fc0be22881c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:51:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-042a78ac-e95b-45ae-8a9f-9fc0be22881c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:51:21 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] No VIF found with MAC fa:16:3e:4d:1f:9f, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Updating instance_info_cache with network_info: [{"id": "abbdb247-c34c-4e34-a214-4752c749a42a", "address": "fa:16:3e:4d:1f:9f", "network": {"id": "206b243c-9e14-4604-8007-2184c3ab67d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1553675839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f56a4ff471842b08578b281d4c7f6ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbdb247-c3", "ovs_interfaceid": "abbdb247-c34c-4e34-a214-4752c749a42a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-042a78ac-e95b-45ae-8a9f-9fc0be22881c" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:51:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:26 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:51:26 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7731MB free_disk=25.603954315185547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1c5d5313-72f0-4f49-83b7-f277d5da4191 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 5e42f38e-e10f-43b7-89ab-ab22addfcf95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 042a78ac-e95b-45ae-8a9f-9fc0be22881c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 0c76f879-d140-484b-89ed-8d4012f44a7f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance be9a6bab-6958-43bb-9ed8-a531e05ed98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b8a97889-399d-46ec-ac9a-8d2db324ce69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 5cb074cb-b061-4b25-baef-230f5198313c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance e8268040-8dbe-4320-94e9-f6cdaf4eb157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:51:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ulwqvmXo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:51:35 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:51:35 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:51:35 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b29f22-e802-412d-9f94-c8389e9367d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:51:35 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[225cc482-4c1e-4e08-9cd6-67ef0f584aea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e] added
Oct 26 15:51:35 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f86466-de26-4953-b365-6905bfdf5407]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e0bf30-6cfb-40ef-bcaf-90f185f2e1c5]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ulwqvmXo {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ulwqvmXo" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe18e39-75f3-44ed-98ec-86ff2c28c27b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ulwqvmXo'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e54e69-c129-4b41-9b1d-ed1f10983b20]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[43280471-a31d-4456-baad-cabe2842fbc6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:35 user nova-compute[74646]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 (non-flash)
Oct 26 15:51:35 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:35 user nova-compute[74646]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 (non-flash)
Oct 26 15:51:35 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e921e6f7-5055-4cd0-8adc-65192fe090d0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260]
Oct 26 15:51:35 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260] successful.
Oct 26 15:51:35 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1210acca-be38-46a1-ac91-d94821b28f59]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f5086a-a716-450f-8429-fa66afdf4ce5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:35 user nova-compute[74646]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 (non-flash)
Oct 26 15:51:35 user nova-compute[74646]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:51:35 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:35 user nova-compute[74646]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 (non-flash)
Oct 26 15:51:35 user nova-compute[74646]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:51:35 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:51:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:36 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bb5913-7f30-4e0b-b4fa-fafe8c70cc36]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:36 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:51:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ulwqvmXo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:51:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0a04c12a-3702-4bca-8433-88b9c479cc71 tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 72.659s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23736613136396662', 'path': '/dev/sdd'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736613136396662', 'path': '/dev/sdd'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG nova.objects.instance [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lazy-loading 'flavor' on Instance uuid b8a97889-399d-46ec-ac9a-8d2db324ce69 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 15:51:37 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:51:37 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 15:51:37 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:51:37 user nova-compute[74646]:   <serial>b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e</serial>
Oct 26 15:51:37 user nova-compute[74646]: </disk>
Oct 26 15:51:37 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:37 user nova-compute[74646]: INFO nova.compute.manager [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Detaching volume e8f1e24c-2860-4389-b914-36c23bd904c0
Oct 26 15:51:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquiring lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquiring lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] No VIF found with MAC fa:16:3e:a7:f3:71, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:51:37 user nova-compute[74646]: INFO nova.compute.manager [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Terminating instance
Oct 26 15:51:37 user nova-compute[74646]: DEBUG nova.compute.manager [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 15:51:37 user nova-compute[74646]: INFO nova.virt.block_device [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Attempting to driver detach volume e8f1e24c-2860-4389-b914-36c23bd904c0 from mountpoint /dev/vdb
Oct 26 15:51:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Attempting to detach device vdb from instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 15:51:37 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:51:37 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 15:51:37 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:51:37 user nova-compute[74646]:   <serial>e8f1e24c-2860-4389-b914-36c23bd904c0</serial>
Oct 26 15:51:37 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 15:51:37 user nova-compute[74646]: </disk>
Oct 26 15:51:37 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:51:37 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Successfully detached device vdb from instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe from the persistent domain config.
Oct 26 15:51:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 15:51:37 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:51:37 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 15:51:37 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:51:37 user nova-compute[74646]:   <serial>e8f1e24c-2860-4389-b914-36c23bd904c0</serial>
Oct 26 15:51:37 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 15:51:37 user nova-compute[74646]: </disk>
Oct 26 15:51:37 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2ac260e1-7b1a-44b0-a6c8-50e1f08aa928 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.708s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG nova.compute.manager [req-80cf280e-2751-4bab-bb71-2266738d885d req-f777cd18-10a7-4669-894e-6f10adddacd0 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Received event network-vif-unplugged-abbdb247-c34c-4e34-a214-4752c749a42a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-80cf280e-2751-4bab-bb71-2266738d885d req-f777cd18-10a7-4669-894e-6f10adddacd0 service nova] Acquiring lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-80cf280e-2751-4bab-bb71-2266738d885d req-f777cd18-10a7-4669-894e-6f10adddacd0 service nova] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-80cf280e-2751-4bab-bb71-2266738d885d req-f777cd18-10a7-4669-894e-6f10adddacd0 service nova] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG nova.compute.manager [req-80cf280e-2751-4bab-bb71-2266738d885d req-f777cd18-10a7-4669-894e-6f10adddacd0 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] No waiting events found dispatching network-vif-unplugged-abbdb247-c34c-4e34-a214-4752c749a42a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG nova.compute.manager [req-80cf280e-2751-4bab-bb71-2266738d885d req-f777cd18-10a7-4669-894e-6f10adddacd0 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Received event network-vif-unplugged-abbdb247-c34c-4e34-a214-4752c749a42a for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:38 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Instance destroyed successfully.
Oct 26 15:51:38 user nova-compute[74646]: DEBUG nova.objects.instance [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lazy-loading 'resources' on Instance uuid 042a78ac-e95b-45ae-8a9f-9fc0be22881c {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:48:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-168873447',display_name='tempest-DeleteServersTestJSON-server-168873447',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-168873447',id=3,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:48:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f56a4ff471842b08578b281d4c7f6ab',ramdisk_id='',reservation_id='r-qiz3f51v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1914251399',owner_user_name='tempest-DeleteServersTestJSON-1914251399-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:48:36Z,user_data=None,user_id='243594cee6354d3c9b908d2d51d07186',uuid=042a78ac-e95b-45ae-8a9f-9fc0be22881c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abbdb247-c34c-4e34-a214-4752c749a42a", "address": "fa:16:3e:4d:1f:9f", "network": {"id": "206b243c-9e14-4604-8007-2184c3ab67d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1553675839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f56a4ff471842b08578b281d4c7f6ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbdb247-c3", "ovs_interfaceid": "abbdb247-c34c-4e34-a214-4752c749a42a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Converting VIF {"id": "abbdb247-c34c-4e34-a214-4752c749a42a", "address": "fa:16:3e:4d:1f:9f", "network": {"id": "206b243c-9e14-4604-8007-2184c3ab67d2", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1553675839-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f56a4ff471842b08578b281d4c7f6ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabbdb247-c3", "ovs_interfaceid": "abbdb247-c34c-4e34-a214-4752c749a42a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:1f:9f,bridge_name='br-int',has_traffic_filtering=True,id=abbdb247-c34c-4e34-a214-4752c749a42a,network=Network(206b243c-9e14-4604-8007-2184c3ab67d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbdb247-c3') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_vif [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:1f:9f,bridge_name='br-int',has_traffic_filtering=True,id=abbdb247-c34c-4e34-a214-4752c749a42a,network=Network(206b243c-9e14-4604-8007-2184c3ab67d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbdb247-c3') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabbdb247-c3, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2eeeae4a-c21c-45da-96d1-046019f978e4) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:51:38 user nova-compute[74646]: INFO os_vif [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:1f:9f,bridge_name='br-int',has_traffic_filtering=True,id=abbdb247-c34c-4e34-a214-4752c749a42a,network=Network(206b243c-9e14-4604-8007-2184c3ab67d2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabbdb247-c3')
Oct 26 15:51:38 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYqjuylE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:51:38 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5213f3af-b61f-4929-8e89-3028bd014ec6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:51:38 user nova-compute[74646]: No targets found.
Oct 26 15:51:38 user nova-compute[74646]: iSNS:
Oct 26 15:51:38 user nova-compute[74646]: No targets found.
Oct 26 15:51:38 user nova-compute[74646]: STATIC:
Oct 26 15:51:38 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e
Oct 26 15:51:38 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:51:38 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:51:38 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0
Oct 26 15:51:38 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:51:38 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:51:38 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901
Oct 26 15:51:38 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:51:38 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:51:38 user nova-compute[74646]: FIRMWARE:
Oct 26 15:51:38 user nova-compute[74646]: No targets found.
Oct 26 15:51:38 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:51:38 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:51:38 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec73f61-8039-481b-a523-6c32f459828a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6204fd-37e6-45c8-8995-92add6784c7d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:38 user nova-compute[74646]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 (non-flash)
Oct 26 15:51:38 user nova-compute[74646]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:51:38 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:38 user nova-compute[74646]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 (non-flash)
Oct 26 15:51:38 user nova-compute[74646]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:51:38 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e037b760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901'): ({'sdc'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Removing single pathed devices sdc {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d104ef-96a0-4d7a-aba7-e70bb7f40f82]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08ae0b7-eed7-4597-862c-b0473b841acb]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Flushing IO for device /dev/sdc {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Acquiring lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00bc683-03aa-4af7-84bc-26a42fe76442]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.utils [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d8b814-b876-4df1-a600-c433887736ac]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b82dab-f48a-45ff-ad31-f5d92974400e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9d5f99-7bff-4a5c-88b8-78cc5f5479bd]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c22ea25-7cef-4345-b343-9458af66c276]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2a4f3c-47e4-4c35-90ed-0741af1937b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59dfbb6-d6bc-41be-9f89-b3908f8aedf1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:51:39 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43267c9-e406-4e0c-a205-cdb6b8b9f9b3]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea69e703-bf58-4b6c-956b-0291fbb089c5]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901, portal: 172.16.0.220,3260]
Oct 26 15:51:39 user nova-compute[74646]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901, portal: 172.16.0.220,3260] successful.
Oct 26 15:51:39 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG os_brick.utils [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5934d9eb-f0d1-4686-a7cb-f1e937e03901 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[94458805-f232-4f85-8e18-951ee7367933]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] <== disconnect_volume: return (377ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:51:39 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Deleting instance files /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c_del
Oct 26 15:51:39 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Deletion of /opt/stack/data/nova/instances/042a78ac-e95b-45ae-8a9f-9fc0be22881c_del complete
Oct 26 15:51:39 user nova-compute[74646]: INFO nova.compute.manager [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Swapping volume b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e for 6f434a4a-7fc0-4202-a626-c63a0c54769a
Oct 26 15:51:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74646) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 26 15:51:39 user nova-compute[74646]: INFO nova.virt.libvirt.host [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] UEFI support detected
Oct 26 15:51:39 user nova-compute[74646]: INFO nova.compute.manager [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Took 1.72 seconds to destroy the instance on the hypervisor.
Oct 26 15:51:39 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 15:51:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-e8c19a81-4683-414d-b768-aa687c6b4ecd req-143c3370-8091-4eb2-b19d-90ac83c01f74 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Received event network-vif-plugged-abbdb247-c34c-4e34-a214-4752c749a42a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e8c19a81-4683-414d-b768-aa687c6b4ecd req-143c3370-8091-4eb2-b19d-90ac83c01f74 service nova] Acquiring lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e8c19a81-4683-414d-b768-aa687c6b4ecd req-143c3370-8091-4eb2-b19d-90ac83c01f74 service nova] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e8c19a81-4683-414d-b768-aa687c6b4ecd req-143c3370-8091-4eb2-b19d-90ac83c01f74 service nova] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-e8c19a81-4683-414d-b768-aa687c6b4ecd req-143c3370-8091-4eb2-b19d-90ac83c01f74 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] No waiting events found dispatching network-vif-plugged-abbdb247-c34c-4e34-a214-4752c749a42a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:51:40 user nova-compute[74646]: WARNING nova.compute.manager [req-e8c19a81-4683-414d-b768-aa687c6b4ecd req-143c3370-8091-4eb2-b19d-90ac83c01f74 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Received unexpected event network-vif-plugged-abbdb247-c34c-4e34-a214-4752c749a42a for instance with vm_state active and task_state deleting.
Oct 26 15:51:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZnadKhm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:51:40 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:51:40 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:51:40 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8409fb84-86c2-4add-9d09-6e269298728c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:51:40 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:40 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Took 1.25 seconds to deallocate network for instance.
Oct 26 15:51:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-ba9cd4e1-8aa5-4235-96dd-8c8747b0707f req-f233c660-99ce-49c1-9ce5-6244c39ae883 service nova] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Received event network-vif-deleted-abbdb247-c34c-4e34-a214-4752c749a42a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b48015-6b34-4359-b165-418521891301]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4] added
Oct 26 15:51:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a277fbf-8609-4c95-bef6-efeb1eb04657]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1702ef8-43b4-4ace-b082-a42b14bc8198]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LZnadKhm {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LZnadKhm" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5894ede-7379-4abc-83dd-341d088696e8]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LZnadKhm'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab29e01-f3db-4623-a209-c1aa87813458]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab01a93a-ba19-40e3-8f7d-8b367bf3e98b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:40 user nova-compute[74646]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:51:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:40 user nova-compute[74646]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:51:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[95676645-9058-41bb-9fdb-b23ec6d3e155]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4, portal: 172.16.0.220,3260]
Oct 26 15:51:40 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4, portal: 172.16.0.220,3260] successful.
Oct 26 15:51:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d5ac43-0ae9-42c3-baff-014421464086]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b7c5c2-cf51-4dbd-90f7-8e9df36d1358]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:40 user nova-compute[74646]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:51:40 user nova-compute[74646]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)
Oct 26 15:51:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:40 user nova-compute[74646]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:51:40 user nova-compute[74646]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)
Oct 26 15:51:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] HCTL ('34', '-', '-', 0) found on session 5 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[85601c10-aab2-4430-994d-46bf03d64c6b]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Searching for a device in session 5 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:51:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZnadKhm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBxuEymc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:51:41 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:51:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23033303530353162', 'path': '/dev/sdc'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033303530353162', 'path': '/dev/sdc'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.877s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:51:41 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:51:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:51:41 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:51:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG nova.objects.instance [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lazy-loading 'flavor' on Instance uuid be9a6bab-6958-43bb-9ed8-a531e05ed98d {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf5329d-15f1-4863-b283-0a4bd088c6de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:51:41 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ac6a59-edd3-4642-aa28-24324fe938a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931] added
Oct 26 15:51:41 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b63382-a0f5-4ae5-81c1-6dbf7ecc2ab1]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] attach device xml: <disk type="block" device="disk">
Oct 26 15:51:41 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:51:41 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 15:51:41 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:51:41 user nova-compute[74646]:   <serial>3c3a665e-e29e-4a87-80e3-de831a1943a4</serial>
Oct 26 15:51:41 user nova-compute[74646]: </disk>
Oct 26 15:51:41 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4143166b-76a4-48c5-9499-58df4aabc926]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBxuEymc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CBxuEymc" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f71b0a-8c95-48ea-89ce-803789dcb913]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CBxuEymc'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b9b910-299a-4770-a969-f8c19f4e09c9]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0be376-dacf-4fe2-8c13-a28d181ce0c1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:42 user nova-compute[74646]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:51:42 user nova-compute[74646]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)
Oct 26 15:51:42 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:42 user nova-compute[74646]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:51:42 user nova-compute[74646]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)
Oct 26 15:51:42 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceef0c5f-517a-4f88-8c92-ccdb2ffc9145]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931, portal: 172.16.0.220,3260]
Oct 26 15:51:42 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931, portal: 172.16.0.220,3260] successful.
Oct 26 15:51:42 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e9f342-4d81-475e-a13e-d7d251ff654f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b673fd0-c058-4551-ae09-55a2ec6882ec]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:42 user nova-compute[74646]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:51:42 user nova-compute[74646]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)
Oct 26 15:51:42 user nova-compute[74646]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)
Oct 26 15:51:42 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:42 user nova-compute[74646]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:51:42 user nova-compute[74646]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)
Oct 26 15:51:42 user nova-compute[74646]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)
Oct 26 15:51:42 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[385895f4-ada4-4828-a361-cca33ae1526b]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBxuEymc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] No VIF found with MAC fa:16:3e:4e:a7:bf, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:51:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b11ce081-36ed-405f-98b4-8cc5d6d89b52 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 61.590s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:43 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:51:43 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] <== connect_volume: return (2247ms) {'type': 'block', 'scsi_wwn': '26639373764633264', 'path': '/dev/sde'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:51:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26639373764633264', 'path': '/dev/sde'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:51:43 user nova-compute[74646]: DEBUG nova.objects.instance [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lazy-loading 'flavor' on Instance uuid 0c76f879-d140-484b-89ed-8d4012f44a7f {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:51:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 15:51:43 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:51:43 user nova-compute[74646]:   <source dev="/dev/sde"/>
Oct 26 15:51:43 user nova-compute[74646]:   <target dev="sdc" bus="scsi"/>
Oct 26 15:51:43 user nova-compute[74646]:   <serial>c5a3b56c-4131-46b9-bd4c-d970c07c9931</serial>
Oct 26 15:51:43 user nova-compute[74646]:   <address type="drive" controller="0" unit="2"/>
Oct 26 15:51:43 user nova-compute[74646]: </disk>
Oct 26 15:51:43 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 15:51:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-43885b11-7fef-433f-8270-d4d86e24f602 tempest-VolumesAssistedSnapshotsTest-157230163 tempest-VolumesAssistedSnapshotsTest-157230163-project] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] volume_snapshot_create: create_info: {'snapshot_id': 'e6216cab-bb11-4820-b747-4e9319dc699b', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74646) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 26 15:51:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-43885b11-7fef-433f-8270-d4d86e24f602 tempest-VolumesAssistedSnapshotsTest-157230163 tempest-VolumesAssistedSnapshotsTest-157230163-project] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] snap xml: <domainsnapshot>
Oct 26 15:51:43 user nova-compute[74646]:   <disks>
Oct 26 15:51:43 user nova-compute[74646]:     <disk name="/dev/sdc" snapshot="external" type="file">
Oct 26 15:51:43 user nova-compute[74646]:       <source file="/dev/new_file"/>
Oct 26 15:51:43 user nova-compute[74646]:     </disk>
Oct 26 15:51:43 user nova-compute[74646]:     <disk name="vda" snapshot="no"/>
Oct 26 15:51:43 user nova-compute[74646]:   </disks>
Oct 26 15:51:43 user nova-compute[74646]: </domainsnapshot>
Oct 26 15:51:43 user nova-compute[74646]:  {{(pid=74646) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 26 15:51:43 user nova-compute[74646]: DEBUG nova.objects.instance [None req-43885b11-7fef-433f-8270-d4d86e24f602 tempest-VolumesAssistedSnapshotsTest-157230163 tempest-VolumesAssistedSnapshotsTest-157230163-project] Lazy-loading 'system_metadata' on Instance uuid be9a6bab-6958-43bb-9ed8-a531e05ed98d {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:51:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] No BDM found with device name sda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:51:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:51:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:51:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] No VIF found with MAC fa:16:3e:51:bc:da, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:51:43 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-43885b11-7fef-433f-8270-d4d86e24f602 tempest-VolumesAssistedSnapshotsTest-157230163 tempest-VolumesAssistedSnapshotsTest-157230163-project] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [None req-43885b11-7fef-433f-8270-d4d86e24f602 tempest-VolumesAssistedSnapshotsTest-157230163 tempest-VolumesAssistedSnapshotsTest-157230163-project] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Traceback (most recent call last):
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     rv = execute(f, *args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     six.reraise(c, e, tb)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     raise value
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     rv = meth(*args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] 
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [None req-43885b11-7fef-433f-8270-d4d86e24f602 tempest-VolumesAssistedSnapshotsTest-157230163 tempest-VolumesAssistedSnapshotsTest-157230163-project] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Traceback (most recent call last):
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     self._volume_snapshot_create(context, instance, guest,
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     rv = execute(f, *args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     six.reraise(c, e, tb)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     raise value
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     rv = meth(*args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] 
Oct 26 15:51:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-85091a80-b21c-4402-833f-8562ff8262bf tempest-VolumesAssistedSnapshotsTest-157230163 tempest-VolumesAssistedSnapshotsTest-157230163-project] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] volume_snapshot_delete: delete_info: {'volume_id': '3c3a665e-e29e-4a87-80e3-de831a1943a4'} {{(pid=74646) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [None req-85091a80-b21c-4402-833f-8562ff8262bf tempest-VolumesAssistedSnapshotsTest-157230163 tempest-VolumesAssistedSnapshotsTest-157230163-project] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Traceback (most recent call last):
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d]     if delete_info['type'] != 'qcow2':
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] KeyError: 'type'
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] 
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [None req-43885b11-7fef-433f-8270-d4d86e24f602 tempest-VolumesAssistedSnapshotsTest-157230163 tempest-VolumesAssistedSnapshotsTest-157230163-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot e6216cab-bb11-4820-b747-4e9319dc699b could not be found.
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     raise value
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver 
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver 
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot e6216cab-bb11-4820-b747-4e9319dc699b could not be found. (HTTP 404) (Request-ID: req-cea91eed-3fce-47a3-9371-dec0c6397820)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver 
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver 
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot e6216cab-bb11-4820-b747-4e9319dc699b could not be found.
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver 
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server [None req-43885b11-7fef-433f-8270-d4d86e24f602 tempest-VolumesAssistedSnapshotsTest-157230163 tempest-VolumesAssistedSnapshotsTest-157230163-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise value
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server 
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver [None req-85091a80-b21c-4402-833f-8562ff8262bf tempest-VolumesAssistedSnapshotsTest-157230163 tempest-VolumesAssistedSnapshotsTest-157230163-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver 
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver 
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-41c96272-6c7b-4a04-8b30-7e8996098d5a)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver 
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver 
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 26 15:51:44 user nova-compute[74646]: ERROR nova.virt.libvirt.driver 
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server [None req-85091a80-b21c-4402-833f-8562ff8262bf tempest-VolumesAssistedSnapshotsTest-157230163 tempest-VolumesAssistedSnapshotsTest-157230163-project] Exception during message handling: KeyError: 'type'
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 26 15:51:44 user nova-compute[74646]: ERROR oslo_messaging.rpc.server 
Oct 26 15:51:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-755d3c72-98a2-462f-9f83-7e497021fce4 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.777s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Acquiring lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:44 user nova-compute[74646]: INFO nova.compute.manager [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Detaching volume 3c3a665e-e29e-4a87-80e3-de831a1943a4
Oct 26 15:51:44 user nova-compute[74646]: INFO nova.virt.block_device [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Attempting to driver detach volume 3c3a665e-e29e-4a87-80e3-de831a1943a4 from mountpoint /dev/vdb
Oct 26 15:51:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Attempting to detach device vdb from instance be9a6bab-6958-43bb-9ed8-a531e05ed98d from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 15:51:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] detach device xml: <disk type="block" device="disk">
Oct 26 15:51:44 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:51:44 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 15:51:44 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:51:44 user nova-compute[74646]:   <serial>3c3a665e-e29e-4a87-80e3-de831a1943a4</serial>
Oct 26 15:51:44 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 15:51:44 user nova-compute[74646]: </disk>
Oct 26 15:51:44 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:51:44 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Successfully detached device vdb from instance be9a6bab-6958-43bb-9ed8-a531e05ed98d from the persistent domain config.
Oct 26 15:51:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance be9a6bab-6958-43bb-9ed8-a531e05ed98d from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 15:51:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] detach device xml: <disk type="block" device="disk">
Oct 26 15:51:44 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:51:44 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 15:51:44 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:51:44 user nova-compute[74646]:   <serial>3c3a665e-e29e-4a87-80e3-de831a1943a4</serial>
Oct 26 15:51:44 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 15:51:44 user nova-compute[74646]: </disk>
Oct 26 15:51:44 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:51:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "0c76f879-d140-484b-89ed-8d4012f44a7f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:45 user nova-compute[74646]: INFO nova.compute.manager [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Detaching volume c5a3b56c-4131-46b9-bd4c-d970c07c9931
Oct 26 15:51:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance be9a6bab-6958-43bb-9ed8-a531e05ed98d {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 15:51:45 user nova-compute[74646]: INFO nova.virt.block_device [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Attempting to driver detach volume c5a3b56c-4131-46b9-bd4c-d970c07c9931 from mountpoint /dev/sdc
Oct 26 15:51:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Attempting to detach device sdc from instance 0c76f879-d140-484b-89ed-8d4012f44a7f from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 15:51:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 15:51:45 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:51:45 user nova-compute[74646]:   <source dev="/dev/sde"/>
Oct 26 15:51:45 user nova-compute[74646]:   <target dev="sdc" bus="scsi"/>
Oct 26 15:51:45 user nova-compute[74646]:   <serial>c5a3b56c-4131-46b9-bd4c-d970c07c9931</serial>
Oct 26 15:51:45 user nova-compute[74646]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 26 15:51:45 user nova-compute[74646]: </disk>
Oct 26 15:51:45 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:51:45 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Successfully detached device sdc from instance 0c76f879-d140-484b-89ed-8d4012f44a7f from the persistent domain config.
Oct 26 15:51:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 0c76f879-d140-484b-89ed-8d4012f44a7f from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 15:51:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 15:51:45 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:51:45 user nova-compute[74646]:   <source dev="/dev/sde"/>
Oct 26 15:51:45 user nova-compute[74646]:   <target dev="sdc" bus="scsi"/>
Oct 26 15:51:45 user nova-compute[74646]:   <serial>c5a3b56c-4131-46b9-bd4c-d970c07c9931</serial>
Oct 26 15:51:45 user nova-compute[74646]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 26 15:51:45 user nova-compute[74646]: </disk>
Oct 26 15:51:45 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:51:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 0c76f879-d140-484b-89ed-8d4012f44a7f {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 15:51:47 user nova-compute[74646]: INFO nova.compute.manager [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] [instance: 042a78ac-e95b-45ae-8a9f-9fc0be22881c] Took 6.60 seconds to detach 1 volumes for instance.
Oct 26 15:51:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:47 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:51:47 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:51:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:47 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Deleted allocations for instance 042a78ac-e95b-45ae-8a9f-9fc0be22881c
Oct 26 15:51:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4e662ded-a6aa-42a6-9606-086959dc9abd tempest-DeleteServersTestJSON-1914251399 tempest-DeleteServersTestJSON-1914251399-project-member] Lock "042a78ac-e95b-45ae-8a9f-9fc0be22881c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.380s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:51:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:51:48 user nova-compute[74646]: INFO nova.compute.claims [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Claim successful on node user
Oct 26 15:51:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:51:48 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:51:48 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:51:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.605s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG nova.compute.manager [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:51:49 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:51:49 user nova-compute[74646]: DEBUG nova.compute.manager [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:51:49 user nova-compute[74646]: INFO nova.virt.block_device [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Booting with volume c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 at /dev/vda
Oct 26 15:51:49 user nova-compute[74646]: DEBUG nova.policy [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0e35d67fdc0e46b098e239342ef9e506', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd31de955f0540b89ca2d4bcaaf5746e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG os_brick.utils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1d341c-5661-45ae-bd7e-b54dc7cb1100]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec191d51-9921-4b25-b736-ab66c4f359c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faa7471-d91c-4117-a06b-c66e56844baf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca27f69-a607-4372-a955-f8899c1b747a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:51:49 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:51:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9cc024a-6df0-4559-b14b-1bb387d60563]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG os_brick.utils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updating existing volume attachment record: 92158b16-1a5c-447e-84f7-555f10e2496f {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:51:49 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Successfully created port: d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:51:50 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Successfully created port: 7b891259-d291-4d80-bac2-c269b053975d {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:51:51 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Successfully created port: 80847d8e-3acc-4bfd-8ae6-f772c5212e2e {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:51:52 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Successfully created port: 25359995-da39-408c-85d6-7f9b16b8c3f9 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:51:52 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Successfully created port: 22241012-3061-44ab-b747-14a46854c933 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:51:53 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Successfully updated port: d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:51:53 user nova-compute[74646]: DEBUG nova.compute.manager [req-fa4d858f-25d8-49c1-91f6-a8e0131047dd req-00e55f87-ce5d-4a96-a307-b646c7c8217c service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-changed-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:51:53 user nova-compute[74646]: DEBUG nova.compute.manager [req-fa4d858f-25d8-49c1-91f6-a8e0131047dd req-00e55f87-ce5d-4a96-a307-b646c7c8217c service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing instance network info cache due to event network-changed-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:51:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fa4d858f-25d8-49c1-91f6-a8e0131047dd req-00e55f87-ce5d-4a96-a307-b646c7c8217c service nova] Acquiring lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:51:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fa4d858f-25d8-49c1-91f6-a8e0131047dd req-00e55f87-ce5d-4a96-a307-b646c7c8217c service nova] Acquired lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:51:53 user nova-compute[74646]: DEBUG nova.network.neutron [req-fa4d858f-25d8-49c1-91f6-a8e0131047dd req-00e55f87-ce5d-4a96-a307-b646c7c8217c service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing network info cache for port d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:51:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:51:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:53 user nova-compute[74646]: DEBUG nova.network.neutron [req-fa4d858f-25d8-49c1-91f6-a8e0131047dd req-00e55f87-ce5d-4a96-a307-b646c7c8217c service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:51:53 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:51:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:51:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:51:53 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:51:53 user nova-compute[74646]: INFO nova.compute.claims [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Claim successful on node user
Oct 26 15:51:54 user nova-compute[74646]: DEBUG nova.network.neutron [req-fa4d858f-25d8-49c1-91f6-a8e0131047dd req-00e55f87-ce5d-4a96-a307-b646c7c8217c service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fa4d858f-25d8-49c1-91f6-a8e0131047dd req-00e55f87-ce5d-4a96-a307-b646c7c8217c service nova] Releasing lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Successfully updated port: ca4e1d8b-97cd-4389-ad34-7f6a290740c0 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:51:54 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:51:54 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:51:54 user nova-compute[74646]: INFO nova.virt.block_device [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Booting with volume 8b515835-42e3-4304-ab91-13eb78f289eb at /dev/vda
Oct 26 15:51:54 user nova-compute[74646]: DEBUG nova.policy [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7df1f6464b92453296f2985cd77e95fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0beca39b7190412597eb3a5b27a26a99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG os_brick.utils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c06661-55d6-4d8d-b36e-82dd14d46937]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[24410ed7-4685-49f3-b44d-881971cfb0db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:54 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f266ad52-1fb8-4668-b0a5-c2e9cf4783d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3dda176-ad6d-449e-8c88-2d03e3b4993d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:51:55 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:51:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ae989e-e43f-4802-83dc-ff4a1f5e5c97]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG os_brick.utils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating existing volume attachment record: dcee5015-5675-4949-983a-0c3d89638373 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Successfully updated port: 6e68929c-fcd8-41eb-b969-28df0d9a1b4e {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Successfully created port: 95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-changed-ca4e1d8b-97cd-4389-ad34-7f6a290740c0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing instance network info cache due to event network-changed-ca4e1d8b-97cd-4389-ad34-7f6a290740c0. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] Acquiring lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] Acquired lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG nova.network.neutron [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing network info cache for port ca4e1d8b-97cd-4389-ad34-7f6a290740c0 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Successfully updated port: 7b891259-d291-4d80-bac2-c269b053975d {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:51:55 user nova-compute[74646]: DEBUG nova.network.neutron [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:51:56 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Successfully created port: 0cf56ceb-7a00-44df-8241-64aa699593d0 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:51:56 user nova-compute[74646]: DEBUG nova.network.neutron [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:51:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] Releasing lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:51:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-changed-6e68929c-fcd8-41eb-b969-28df0d9a1b4e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:51:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing instance network info cache due to event network-changed-6e68929c-fcd8-41eb-b969-28df0d9a1b4e. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:51:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] Acquiring lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:51:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] Acquired lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:51:56 user nova-compute[74646]: DEBUG nova.network.neutron [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing network info cache for port 6e68929c-fcd8-41eb-b969-28df0d9a1b4e {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:51:56 user nova-compute[74646]: DEBUG nova.network.neutron [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:51:56 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Successfully updated port: 80847d8e-3acc-4bfd-8ae6-f772c5212e2e {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:51:56 user nova-compute[74646]: DEBUG nova.network.neutron [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:51:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e9d3d4be-cc19-4496-9c10-03e6294e305d req-4a06c3a5-4a23-418b-8c4b-0a1f895b1b9b service nova] Releasing lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:51:56 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Successfully created port: 9d77193f-b6bb-4a85-9380-d46735e5232b {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:51:57 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Successfully updated port: 25359995-da39-408c-85d6-7f9b16b8c3f9 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:51:57 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Successfully created port: cbf3c1ca-d650-4636-938c-168459a271d8 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:51:57 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Successfully updated port: 22241012-3061-44ab-b747-14a46854c933 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:51:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:51:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquired lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:51:57 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:51:57 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:51:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-changed-7b891259-d291-4d80-bac2-c269b053975d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:51:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing instance network info cache due to event network-changed-7b891259-d291-4d80-bac2-c269b053975d. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:51:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] Acquiring lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Successfully created port: 28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:51:58 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe is timed out.
Oct 26 15:51:58 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Successfully detached device vdb from instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe from the live domain config.
Oct 26 15:51:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PwDrKaMk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:51:58 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[450e65d8-2a3f-48e9-aa6c-3b444b9ff2c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:51:58 user nova-compute[74646]: No targets found.
Oct 26 15:51:58 user nova-compute[74646]: iSNS:
Oct 26 15:51:58 user nova-compute[74646]: No targets found.
Oct 26 15:51:58 user nova-compute[74646]: STATIC:
Oct 26 15:51:58 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4
Oct 26 15:51:58 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:51:58 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:51:58 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e
Oct 26 15:51:58 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:51:58 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:51:58 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0
Oct 26 15:51:58 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:51:58 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:51:58 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931
Oct 26 15:51:58 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:51:58 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:51:58 user nova-compute[74646]: FIRMWARE:
Oct 26 15:51:58 user nova-compute[74646]: No targets found.
Oct 26 15:51:58 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:51:58 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:51:58 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dffab3-d1fc-4631-833b-40f441138de3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1fddff-c6a2-46d4-b4d5-09816ac5764b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:58 user nova-compute[74646]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:51:58 user nova-compute[74646]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)
Oct 26 15:51:58 user nova-compute[74646]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)
Oct 26 15:51:58 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 (non-flash)
Oct 26 15:51:58 user nova-compute[74646]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:51:58 user nova-compute[74646]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)
Oct 26 15:51:58 user nova-compute[74646]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)
Oct 26 15:51:58 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d0739d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0'): ({'sdb'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Removing single pathed devices sdb {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e74b9c-539c-401c-bb52-ec7daf64d442]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62fcb6c-472d-48cb-a4be-2a85a2d7d822]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Flushing IO for device /dev/sdb {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d22096f-1d28-4fb8-bdb8-b52b386ea873]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df0479f-eae6-48e1-b5ad-77cab5b30fb8]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b655f54-f8f8-4600-bde4-533958371c73]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[641c398c-d0f5-420b-9f3f-2ee016b60647]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0, portal: 172.16.0.220,3260]
Oct 26 15:51:58 user nova-compute[74646]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0, portal: 172.16.0.220,3260] successful.
Oct 26 15:51:58 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8f1e24c-2860-4389-b914-36c23bd904c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eabd022-949d-49c4-b9c7-9fcaf888935b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] <== disconnect_volume: return (352ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Successfully updated port: 95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-007c6b28-2b99-430d-820b-41ad512b6597 req-395d62b4-ea65-476c-8bb8-414ae2244f3c service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-changed-95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-007c6b28-2b99-430d-820b-41ad512b6597 req-395d62b4-ea65-476c-8bb8-414ae2244f3c service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing instance network info cache due to event network-changed-95eb1246-2ee9-4a59-979b-79c153fd7d8d. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-007c6b28-2b99-430d-820b-41ad512b6597 req-395d62b4-ea65-476c-8bb8-414ae2244f3c service nova] Acquiring lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-007c6b28-2b99-430d-820b-41ad512b6597 req-395d62b4-ea65-476c-8bb8-414ae2244f3c service nova] Acquired lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG nova.network.neutron [req-007c6b28-2b99-430d-820b-41ad512b6597 req-395d62b4-ea65-476c-8bb8-414ae2244f3c service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing network info cache for port 95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:51:58 user nova-compute[74646]: DEBUG nova.network.neutron [req-007c6b28-2b99-430d-820b-41ad512b6597 req-395d62b4-ea65-476c-8bb8-414ae2244f3c service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:51:59 user nova-compute[74646]: DEBUG nova.network.neutron [req-007c6b28-2b99-430d-820b-41ad512b6597 req-395d62b4-ea65-476c-8bb8-414ae2244f3c service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:51:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-007c6b28-2b99-430d-820b-41ad512b6597 req-395d62b4-ea65-476c-8bb8-414ae2244f3c service nova] Releasing lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:51:59 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Successfully updated port: 15047c00-6637-4474-8e2d-a8c0fa1f0e7b {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:51:59 user nova-compute[74646]: DEBUG nova.network.neutron [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updating instance_info_cache with network_info: [{"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b891259-d291-4d80-bac2-c269b053975d", "address": "fa:16:3e:8f:e1:3d", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b891259-d2", "ovs_interfaceid": "7b891259-d291-4d80-bac2-c269b053975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:51:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Releasing lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:51:59 user nova-compute[74646]: DEBUG nova.compute.manager [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Instance network_info: |[{"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b891259-d291-4d80-bac2-c269b053975d", "address": "fa:16:3e:8f:e1:3d", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b891259-d2", "ovs_interfaceid": "7b891259-d291-4d80-bac2-c269b053975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:51:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] Acquired lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:51:59 user nova-compute[74646]: DEBUG nova.network.neutron [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing network info cache for port 7b891259-d291-4d80-bac2-c269b053975d {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "5cb074cb-b061-4b25-baef-230f5198313c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "5cb074cb-b061-4b25-baef-230f5198313c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "5cb074cb-b061-4b25-baef-230f5198313c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "5cb074cb-b061-4b25-baef-230f5198313c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "5cb074cb-b061-4b25-baef-230f5198313c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:00 user nova-compute[74646]: INFO nova.compute.manager [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Terminating instance
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updated VIF entry in instance network info cache for port 7b891259-d291-4d80-bac2-c269b053975d. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updating instance_info_cache with network_info: [{"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b891259-d291-4d80-bac2-c269b053975d", "address": "fa:16:3e:8f:e1:3d", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b891259-d2", "ovs_interfaceid": "7b891259-d291-4d80-bac2-c269b053975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] Releasing lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-changed-80847d8e-3acc-4bfd-8ae6-f772c5212e2e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing instance network info cache due to event network-changed-80847d8e-3acc-4bfd-8ae6-f772c5212e2e. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] Acquiring lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] Acquired lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing network info cache for port 80847d8e-3acc-4bfd-8ae6-f772c5212e2e {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Successfully updated port: 84740bfb-a2c6-47dd-81f6-1b8b447349d1 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updated VIF entry in instance network info cache for port 80847d8e-3acc-4bfd-8ae6-f772c5212e2e. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updating instance_info_cache with network_info: [{"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b891259-d291-4d80-bac2-c269b053975d", "address": "fa:16:3e:8f:e1:3d", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b891259-d2", "ovs_interfaceid": "7b891259-d291-4d80-bac2-c269b053975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] Releasing lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-changed-25359995-da39-408c-85d6-7f9b16b8c3f9 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing instance network info cache due to event network-changed-25359995-da39-408c-85d6-7f9b16b8c3f9. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] Acquiring lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] Acquired lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing network info cache for port 25359995-da39-408c-85d6-7f9b16b8c3f9 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Successfully updated port: 0cf56ceb-7a00-44df-8241-64aa699593d0 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-changed-15047c00-6637-4474-8e2d-a8c0fa1f0e7b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing instance network info cache due to event network-changed-15047c00-6637-4474-8e2d-a8c0fa1f0e7b. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] Acquiring lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] Acquired lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing network info cache for port 15047c00-6637-4474-8e2d-a8c0fa1f0e7b {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-399b71a3-d3dc-46f8-b879-3528ce7ba6ff req-27a8d157-f00f-4320-95d4-7a20cf4347cd service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-changed-0cf56ceb-7a00-44df-8241-64aa699593d0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-399b71a3-d3dc-46f8-b879-3528ce7ba6ff req-27a8d157-f00f-4320-95d4-7a20cf4347cd service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing instance network info cache due to event network-changed-0cf56ceb-7a00-44df-8241-64aa699593d0. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:52:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-399b71a3-d3dc-46f8-b879-3528ce7ba6ff req-27a8d157-f00f-4320-95d4-7a20cf4347cd service nova] Acquiring lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.network.neutron [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:52:01 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Instance destroyed successfully.
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.objects.instance [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lazy-loading 'resources' on Instance uuid 5cb074cb-b061-4b25-baef-230f5198313c {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:50:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1614563322',display_name='tempest-ServersNegativeTestJSON-server-1614563322',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1614563322',id=8,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:50:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9743ac2f5304819835c4f369c376e31',ramdisk_id='',reservation_id='r-k4epadeg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-986135927',owner_user_name='tempest-ServersNegativeTestJSON-986135927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:50:16Z,user_data=None,user_id='9c53fa7260a54cee97a07bc12f78144e',uuid=5cb074cb-b061-4b25-baef-230f5198313c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2ea9dd30-122d-4046-9664-026972d57759", "address": "fa:16:3e:e0:c8:e5", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea9dd30-12", "ovs_interfaceid": "2ea9dd30-122d-4046-9664-026972d57759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Converting VIF {"id": "2ea9dd30-122d-4046-9664-026972d57759", "address": "fa:16:3e:e0:c8:e5", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2ea9dd30-12", "ovs_interfaceid": "2ea9dd30-122d-4046-9664-026972d57759", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c8:e5,bridge_name='br-int',has_traffic_filtering=True,id=2ea9dd30-122d-4046-9664-026972d57759,network=Network(553f3b75-4be8-40fa-a771-51ae8487bd58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea9dd30-12') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG os_vif [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c8:e5,bridge_name='br-int',has_traffic_filtering=True,id=2ea9dd30-122d-4046-9664-026972d57759,network=Network(553f3b75-4be8-40fa-a771-51ae8487bd58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea9dd30-12') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2ea9dd30-12, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2c12fff7-6176-4acf-a697-9a5b19040084) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:01 user nova-compute[74646]: INFO os_vif [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:c8:e5,bridge_name='br-int',has_traffic_filtering=True,id=2ea9dd30-122d-4046-9664-026972d57759,network=Network(553f3b75-4be8-40fa-a771-51ae8487bd58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2ea9dd30-12')
Oct 26 15:52:01 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Deleting instance files /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c_del
Oct 26 15:52:01 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Deletion of /opt/stack/data/nova/instances/5cb074cb-b061-4b25-baef-230f5198313c_del complete
Oct 26 15:52:01 user nova-compute[74646]: INFO nova.compute.manager [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 26 15:52:01 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.network.neutron [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] Releasing lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-changed-84740bfb-a2c6-47dd-81f6-1b8b447349d1 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing instance network info cache due to event network-changed-84740bfb-a2c6-47dd-81f6-1b8b447349d1. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] Acquiring lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] Acquired lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.network.neutron [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing network info cache for port 84740bfb-a2c6-47dd-81f6-1b8b447349d1 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.network.neutron [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updated VIF entry in instance network info cache for port 25359995-da39-408c-85d6-7f9b16b8c3f9. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.network.neutron [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updating instance_info_cache with network_info: [{"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b891259-d291-4d80-bac2-c269b053975d", "address": "fa:16:3e:8f:e1:3d", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b891259-d2", "ovs_interfaceid": "7b891259-d291-4d80-bac2-c269b053975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] Releasing lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-changed-22241012-3061-44ab-b747-14a46854c933 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing instance network info cache due to event network-changed-22241012-3061-44ab-b747-14a46854c933. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] Acquiring lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] Acquired lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.network.neutron [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing network info cache for port 22241012-3061-44ab-b747-14a46854c933 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.network.neutron [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Successfully updated port: 9d77193f-b6bb-4a85-9380-d46735e5232b {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:01 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Took 0.52 seconds to deallocate network for instance.
Oct 26 15:52:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-2b799cb5-9c04-4225-be87-29bfe523c730 req-189d6236-58d7-4d47-ad4d-5147713ee366 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Received event network-vif-deleted-2ea9dd30-122d-4046-9664-026972d57759 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.compute.manager [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HtRArpuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8a97889-399d-46ec-ac9a-8d2db324ce69', 'attached_at': '', 'detached_at': '', 'volume_id': '6f434a4a-7fc0-4202-a626-c63a0c54769a', 'serial': '6f434a4a-7fc0-4202-a626-c63a0c54769a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ulwqvmXo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'b8a97889-399d-46ec-ac9a-8d2db324ce69', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 'serial'} {{(pid=74646) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.network.neutron [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Successfully updated port: cbf3c1ca-d650-4636-938c-168459a271d8 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] Releasing lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Received event network-vif-unplugged-2ea9dd30-122d-4046-9664-026972d57759 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] Acquiring lock "5cb074cb-b061-4b25-baef-230f5198313c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] Lock "5cb074cb-b061-4b25-baef-230f5198313c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] Lock "5cb074cb-b061-4b25-baef-230f5198313c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] No waiting events found dispatching network-vif-unplugged-2ea9dd30-122d-4046-9664-026972d57759 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Received event network-vif-unplugged-2ea9dd30-122d-4046-9664-026972d57759 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Received event network-vif-plugged-2ea9dd30-122d-4046-9664-026972d57759 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] Acquiring lock "5cb074cb-b061-4b25-baef-230f5198313c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] Lock "5cb074cb-b061-4b25-baef-230f5198313c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] Lock "5cb074cb-b061-4b25-baef-230f5198313c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] No waiting events found dispatching network-vif-plugged-2ea9dd30-122d-4046-9664-026972d57759 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:52:02 user nova-compute[74646]: WARNING nova.compute.manager [req-5d341079-e261-4c52-b180-e794a0a89fa7 req-6464daf3-ea15-4cb7-957b-980dedc5a2d6 service nova] [instance: 5cb074cb-b061-4b25-baef-230f5198313c] Received unexpected event network-vif-plugged-2ea9dd30-122d-4046-9664-026972d57759 for instance with vm_state active and task_state deleting.
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-399b71a3-d3dc-46f8-b879-3528ce7ba6ff req-27a8d157-f00f-4320-95d4-7a20cf4347cd service nova] Acquired lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.network.neutron [req-399b71a3-d3dc-46f8-b879-3528ce7ba6ff req-27a8d157-f00f-4320-95d4-7a20cf4347cd service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing network info cache for port 0cf56ceb-7a00-44df-8241-64aa699593d0 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HtRArpuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:52:02 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:52:02 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:52:02 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e87cdf-73ce-409e-be41-be522255621e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:52:02 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[de56805b-7159-41aa-b109-8d4ad0060545]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a] added
Oct 26 15:52:02 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f348f1-957f-4d9d-87c4-44feba6176a5]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[26298609-3039-49e5-95a3-36aee94621f7]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HtRArpuO {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.network.neutron [req-399b71a3-d3dc-46f8-b879-3528ce7ba6ff req-27a8d157-f00f-4320-95d4-7a20cf4347cd service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HtRArpuO" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6952b9-6ec5-46a3-89cd-847c0c70055d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HtRArpuO'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b21f05-bb27-419b-bf9d-6e15f5862a79]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddedbcd-c069-40f4-b21f-25fab7506917]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:52:02 user nova-compute[74646]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)
Oct 26 15:52:02 user nova-compute[74646]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)
Oct 26 15:52:02 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:52:02 user nova-compute[74646]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)
Oct 26 15:52:02 user nova-compute[74646]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)
Oct 26 15:52:02 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eaafce-d032-4b62-8ae5-1540bbf26e92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a, portal: 172.16.0.220,3260]
Oct 26 15:52:02 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a, portal: 172.16.0.220,3260] successful.
Oct 26 15:52:02 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b0fb94-57d4-4198-aa93-911b92dbc72d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d02e9bb-43e2-4477-acd0-0c3d110c21e3]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:52:02 user nova-compute[74646]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)
Oct 26 15:52:02 user nova-compute[74646]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)
Oct 26 15:52:02 user nova-compute[74646]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)
Oct 26 15:52:02 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:52:02 user nova-compute[74646]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)
Oct 26 15:52:02 user nova-compute[74646]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)
Oct 26 15:52:02 user nova-compute[74646]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)
Oct 26 15:52:02 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.network.neutron [req-399b71a3-d3dc-46f8-b879-3528ce7ba6ff req-27a8d157-f00f-4320-95d4-7a20cf4347cd service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.395s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[528b83a8-e4ed-4a9a-a9fa-33e8a9d7cca2]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HtRArpuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-399b71a3-d3dc-46f8-b879-3528ce7ba6ff req-27a8d157-f00f-4320-95d4-7a20cf4347cd service nova] Releasing lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:52:02 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Deleted allocations for instance 5cb074cb-b061-4b25-baef-230f5198313c
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.network.neutron [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updated VIF entry in instance network info cache for port 22241012-3061-44ab-b747-14a46854c933. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG nova.network.neutron [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updating instance_info_cache with network_info: [{"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b891259-d291-4d80-bac2-c269b053975d", "address": "fa:16:3e:8f:e1:3d", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b891259-d2", "ovs_interfaceid": "7b891259-d291-4d80-bac2-c269b053975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-711c000a-0618-445c-bbd1-6ee3125ce268 req-c643cafe-653e-4855-adc1-6801a8ede75d service nova] Releasing lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:52:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d1ae190a-4171-4d8c-9e00-70b431ef82ca tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "5cb074cb-b061-4b25-baef-230f5198313c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.651s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Successfully updated port: 28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquired lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.compute.manager [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-changed-9d77193f-b6bb-4a85-9380-d46735e5232b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.compute.manager [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing instance network info cache due to event network-changed-9d77193f-b6bb-4a85-9380-d46735e5232b. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] Acquiring lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.objects.instance [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lazy-loading 'flavor' on Instance uuid 8edad9e5-5649-4ac7-a885-ae2d85cfeafe {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c10e503f-936e-4e7b-82e9-addfd645466e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.845s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "interface-8edad9e5-5649-4ac7-a885-ae2d85cfeafe-80bebc53-31f0-4b1e-8abb-50bf65fdbc16" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "interface-8edad9e5-5649-4ac7-a885-ae2d85cfeafe-80bebc53-31f0-4b1e-8abb-50bf65fdbc16" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.objects.instance [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lazy-loading 'flavor' on Instance uuid 8edad9e5-5649-4ac7-a885-ae2d85cfeafe {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-109261951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-109261951',id=6,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORFY2BSLaMhq/E5p+UHLBw9zanVj3hPYzpAhpE2tuRkW9nT+9656pE9yOGjFfMafxl/9w7KQhKQ7j+X841AaJHigdfvo2GKz6ua9+kNxAcYmgo0FYMnOu5s42XAwkFHvw==',key_name='tempest-keypair-1091666697',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2d636dad453466192a545f54098b6ef',ramdisk_id='',reservation_id='r-2mi45cco',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-180887235',owner_user_name='tempest-TaggedAttachmentsTest-180887235-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:49:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='723b9bbed73446b29f877a87c48234fe',uuid=8edad9e5-5649-4ac7-a885-ae2d85cfeafe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "address": "fa:16:3e:82:84:7f", "network": {"id": "8f104fed-08e3-4de9-b66a-7fe8c239c70f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2031322880", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bebc53-31", "ovs_interfaceid": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Converting VIF {"id": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "address": "fa:16:3e:82:84:7f", "network": {"id": "8f104fed-08e3-4de9-b66a-7fe8c239c70f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2031322880", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bebc53-31", "ovs_interfaceid": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7f,bridge_name='br-int',has_traffic_filtering=True,id=80bebc53-31f0-4b1e-8abb-50bf65fdbc16,network=Network(8f104fed-08e3-4de9-b66a-7fe8c239c70f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bebc53-31') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:82:84:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap80bebc53-31"/></interface> {{(pid=74646) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:82:84:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap80bebc53-31"/></interface> {{(pid=74646) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Attempting to detach device tap80bebc53-31 from instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] detach device xml: <interface type="ethernet">
Oct 26 15:52:03 user nova-compute[74646]:   <mac address="fa:16:3e:82:84:7f"/>
Oct 26 15:52:03 user nova-compute[74646]:   <model type="virtio"/>
Oct 26 15:52:03 user nova-compute[74646]:   <mtu size="1442"/>
Oct 26 15:52:03 user nova-compute[74646]:   <target dev="tap80bebc53-31"/>
Oct 26 15:52:03 user nova-compute[74646]: </interface>
Oct 26 15:52:03 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:82:84:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap80bebc53-31"/></interface> {{(pid=74646) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:82:84:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap80bebc53-31"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 26 15:52:03 user nova-compute[74646]:   <name>instance-00000006</name>
Oct 26 15:52:03 user nova-compute[74646]:   <uuid>8edad9e5-5649-4ac7-a885-ae2d85cfeafe</uuid>
Oct 26 15:52:03 user nova-compute[74646]:   <metadata>
Oct 26 15:52:03 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:52:03 user nova-compute[74646]:   <nova:package version="0.0.0"/>
Oct 26 15:52:03 user nova-compute[74646]:   <nova:name>tempest-device-tagging-server-109261951</nova:name>
Oct 26 15:52:03 user nova-compute[74646]:   <nova:creationTime>2023-10-26 15:50:54</nova:creationTime>
Oct 26 15:52:03 user nova-compute[74646]:   <nova:flavor name="m1.tiny">
Oct 26 15:52:03 user nova-compute[74646]:     <nova:memory>512</nova:memory>
Oct 26 15:52:03 user nova-compute[74646]:     <nova:disk>1</nova:disk>
Oct 26 15:52:03 user nova-compute[74646]:     <nova:swap>0</nova:swap>
Oct 26 15:52:03 user nova-compute[74646]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:52:03 user nova-compute[74646]:     <nova:vcpus>1</nova:vcpus>
Oct 26 15:52:03 user nova-compute[74646]:   </nova:flavor>
Oct 26 15:52:03 user nova-compute[74646]:   <nova:owner>
Oct 26 15:52:03 user nova-compute[74646]:     <nova:user uuid="723b9bbed73446b29f877a87c48234fe">tempest-TaggedAttachmentsTest-180887235-project-member</nova:user>
Oct 26 15:52:03 user nova-compute[74646]:     <nova:project uuid="c2d636dad453466192a545f54098b6ef">tempest-TaggedAttachmentsTest-180887235</nova:project>
Oct 26 15:52:03 user nova-compute[74646]:   </nova:owner>
Oct 26 15:52:03 user nova-compute[74646]:   <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:52:03 user nova-compute[74646]:   <nova:ports>
Oct 26 15:52:03 user nova-compute[74646]:     <nova:port uuid="c03623fa-065f-47ad-9127-5fdebf97a32d">
Oct 26 15:52:03 user nova-compute[74646]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 15:52:03 user nova-compute[74646]:     </nova:port>
Oct 26 15:52:03 user nova-compute[74646]:     <nova:port uuid="80bebc53-31f0-4b1e-8abb-50bf65fdbc16">
Oct 26 15:52:03 user nova-compute[74646]:       <nova:ip type="fixed" address="10.10.10.215" ipVersion="4"/>
Oct 26 15:52:03 user nova-compute[74646]:     </nova:port>
Oct 26 15:52:03 user nova-compute[74646]:   </nova:ports>
Oct 26 15:52:03 user nova-compute[74646]: </nova:instance>
Oct 26 15:52:03 user nova-compute[74646]:   </metadata>
Oct 26 15:52:03 user nova-compute[74646]:   <memory unit='KiB'>524288</memory>
Oct 26 15:52:03 user nova-compute[74646]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 15:52:03 user nova-compute[74646]:   <vcpu placement='static'>1</vcpu>
Oct 26 15:52:03 user nova-compute[74646]:   <resource>
Oct 26 15:52:03 user nova-compute[74646]:     <partition>/machine</partition>
Oct 26 15:52:03 user nova-compute[74646]:   </resource>
Oct 26 15:52:03 user nova-compute[74646]:   <sysinfo type='smbios'>
Oct 26 15:52:03 user nova-compute[74646]:     <system>
Oct 26 15:52:03 user nova-compute[74646]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 15:52:03 user nova-compute[74646]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 15:52:03 user nova-compute[74646]:       <entry name='version'>0.0.0</entry>
Oct 26 15:52:03 user nova-compute[74646]:       <entry name='serial'>8edad9e5-5649-4ac7-a885-ae2d85cfeafe</entry>
Oct 26 15:52:03 user nova-compute[74646]:       <entry name='uuid'>8edad9e5-5649-4ac7-a885-ae2d85cfeafe</entry>
Oct 26 15:52:03 user nova-compute[74646]:       <entry name='family'>Virtual Machine</entry>
Oct 26 15:52:03 user nova-compute[74646]:     </system>
Oct 26 15:52:03 user nova-compute[74646]:   </sysinfo>
Oct 26 15:52:03 user nova-compute[74646]:   <os>
Oct 26 15:52:03 user nova-compute[74646]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 15:52:03 user nova-compute[74646]:     <boot dev='hd'/>
Oct 26 15:52:03 user nova-compute[74646]:     <smbios mode='sysinfo'/>
Oct 26 15:52:03 user nova-compute[74646]:   </os>
Oct 26 15:52:03 user nova-compute[74646]:   <features>
Oct 26 15:52:03 user nova-compute[74646]:     <acpi/>
Oct 26 15:52:03 user nova-compute[74646]:     <apic/>
Oct 26 15:52:03 user nova-compute[74646]:     <vmcoreinfo state='on'/>
Oct 26 15:52:03 user nova-compute[74646]:   </features>
Oct 26 15:52:03 user nova-compute[74646]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 15:52:03 user nova-compute[74646]:     <model fallback='forbid'>Nehalem</model>
Oct 26 15:52:03 user nova-compute[74646]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 15:52:03 user nova-compute[74646]:     <feature policy='require' name='vme'/>
Oct 26 15:52:03 user nova-compute[74646]:     <feature policy='require' name='x2apic'/>
Oct 26 15:52:03 user nova-compute[74646]:     <feature policy='require' name='hypervisor'/>
Oct 26 15:52:03 user nova-compute[74646]:   </cpu>
Oct 26 15:52:03 user nova-compute[74646]:   <clock offset='utc'>
Oct 26 15:52:03 user nova-compute[74646]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 15:52:03 user nova-compute[74646]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 15:52:03 user nova-compute[74646]:     <timer name='hpet' present='no'/>
Oct 26 15:52:03 user nova-compute[74646]:   </clock>
Oct 26 15:52:03 user nova-compute[74646]:   <on_poweroff>destroy</on_poweroff>
Oct 26 15:52:03 user nova-compute[74646]:   <on_reboot>restart</on_reboot>
Oct 26 15:52:03 user nova-compute[74646]:   <on_crash>destroy</on_crash>
Oct 26 15:52:03 user nova-compute[74646]:   <devices>
Oct 26 15:52:03 user nova-compute[74646]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 15:52:03 user nova-compute[74646]:     <disk type='file' device='disk'>
Oct 26 15:52:03 user nova-compute[74646]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 15:52:03 user nova-compute[74646]:       <source file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk' index='2'/>
Oct 26 15:52:03 user nova-compute[74646]:       <backingStore type='file' index='3'>
Oct 26 15:52:03 user nova-compute[74646]:         <format type='raw'/>
Oct 26 15:52:03 user nova-compute[74646]:         <source file='/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7'/>
Oct 26 15:52:03 user nova-compute[74646]:         <backingStore/>
Oct 26 15:52:03 user nova-compute[74646]:       </backingStore>
Oct 26 15:52:03 user nova-compute[74646]:       <target dev='vda' bus='virtio'/>
Oct 26 15:52:03 user nova-compute[74646]:       <alias name='virtio-disk0'/>
Oct 26 15:52:03 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 15:52:03 user nova-compute[74646]:     </disk>
Oct 26 15:52:03 user nova-compute[74646]:     <disk type='file' device='cdrom'>
Oct 26 15:52:03 user nova-compute[74646]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 15:52:03 user nova-compute[74646]:       <source file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk.config' index='1'/>
Oct 26 15:52:03 user nova-compute[74646]:       <backingStore/>
Oct 26 15:52:03 user nova-compute[74646]:       <target dev='hda' bus='ide'/>
Oct 26 15:52:03 user nova-compute[74646]:       <readonly/>
Oct 26 15:52:03 user nova-compute[74646]:       <alias name='ide0-0-0'/>
Oct 26 15:52:03 user nova-compute[74646]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 15:52:03 user nova-compute[74646]:     </disk>
Oct 26 15:52:03 user nova-compute[74646]:     <controller type='usb' index='0' model='none'>
Oct 26 15:52:03 user nova-compute[74646]:       <alias name='usb'/>
Oct 26 15:52:03 user nova-compute[74646]:     </controller>
Oct 26 15:52:03 user nova-compute[74646]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 15:52:03 user nova-compute[74646]:       <alias name='pci.0'/>
Oct 26 15:52:03 user nova-compute[74646]:     </controller>
Oct 26 15:52:03 user nova-compute[74646]:     <controller type='ide' index='0'>
Oct 26 15:52:03 user nova-compute[74646]:       <alias name='ide'/>
Oct 26 15:52:03 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 15:52:03 user nova-compute[74646]:     </controller>
Oct 26 15:52:03 user nova-compute[74646]:     <interface type='ethernet'>
Oct 26 15:52:03 user nova-compute[74646]:       <mac address='fa:16:3e:e2:d4:d9'/>
Oct 26 15:52:03 user nova-compute[74646]:       <target dev='tapc03623fa-06'/>
Oct 26 15:52:03 user nova-compute[74646]:       <model type='virtio'/>
Oct 26 15:52:03 user nova-compute[74646]:       <mtu size='1442'/>
Oct 26 15:52:03 user nova-compute[74646]:       <alias name='net0'/>
Oct 26 15:52:03 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 15:52:03 user nova-compute[74646]:     </interface>
Oct 26 15:52:03 user nova-compute[74646]:     <interface type='ethernet'>
Oct 26 15:52:03 user nova-compute[74646]:       <mac address='fa:16:3e:82:84:7f'/>
Oct 26 15:52:03 user nova-compute[74646]:       <target dev='tap80bebc53-31'/>
Oct 26 15:52:03 user nova-compute[74646]:       <model type='virtio'/>
Oct 26 15:52:03 user nova-compute[74646]:       <mtu size='1442'/>
Oct 26 15:52:03 user nova-compute[74646]:       <alias name='net1'/>
Oct 26 15:52:03 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 26 15:52:03 user nova-compute[74646]:     </interface>
Oct 26 15:52:03 user nova-compute[74646]:     <serial type='pty'>
Oct 26 15:52:03 user nova-compute[74646]:       <source path='/dev/pts/5'/>
Oct 26 15:52:03 user nova-compute[74646]:       <log file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/console.log' append='off'/>
Oct 26 15:52:03 user nova-compute[74646]:       <target type='isa-serial' port='0'>
Oct 26 15:52:03 user nova-compute[74646]:         <model name='isa-serial'/>
Oct 26 15:52:03 user nova-compute[74646]:       </target>
Oct 26 15:52:03 user nova-compute[74646]:       <alias name='serial0'/>
Oct 26 15:52:03 user nova-compute[74646]:     </serial>
Oct 26 15:52:03 user nova-compute[74646]:     <console type='pty' tty='/dev/pts/5'>
Oct 26 15:52:03 user nova-compute[74646]:       <source path='/dev/pts/5'/>
Oct 26 15:52:03 user nova-compute[74646]:       <log file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/console.log' append='off'/>
Oct 26 15:52:03 user nova-compute[74646]:       <target type='serial' port='0'/>
Oct 26 15:52:03 user nova-compute[74646]:       <alias name='serial0'/>
Oct 26 15:52:03 user nova-compute[74646]:     </console>
Oct 26 15:52:03 user nova-compute[74646]:     <input type='mouse' bus='ps2'>
Oct 26 15:52:03 user nova-compute[74646]:       <alias name='input0'/>
Oct 26 15:52:03 user nova-compute[74646]:     </input>
Oct 26 15:52:03 user nova-compute[74646]:     <input type='keyboard' bus='ps2'>
Oct 26 15:52:03 user nova-compute[74646]:       <alias name='input1'/>
Oct 26 15:52:03 user nova-compute[74646]:     </input>
Oct 26 15:52:03 user nova-compute[74646]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 26 15:52:03 user nova-compute[74646]:       <listen type='address' address='0.0.0.0'/>
Oct 26 15:52:03 user nova-compute[74646]:     </graphics>
Oct 26 15:52:03 user nova-compute[74646]:     <audio id='1' type='none'/>
Oct 26 15:52:03 user nova-compute[74646]:     <video>
Oct 26 15:52:03 user nova-compute[74646]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 15:52:03 user nova-compute[74646]:       <alias name='video0'/>
Oct 26 15:52:03 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 15:52:03 user nova-compute[74646]:     </video>
Oct 26 15:52:03 user nova-compute[74646]:     <memballoon model='virtio'>
Oct 26 15:52:03 user nova-compute[74646]:       <stats period='10'/>
Oct 26 15:52:03 user nova-compute[74646]:       <alias name='balloon0'/>
Oct 26 15:52:03 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 15:52:03 user nova-compute[74646]:     </memballoon>
Oct 26 15:52:03 user nova-compute[74646]:     <rng model='virtio'>
Oct 26 15:52:03 user nova-compute[74646]:       <backend model='random'>/dev/urandom</backend>
Oct 26 15:52:03 user nova-compute[74646]:       <alias name='rng0'/>
Oct 26 15:52:03 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 15:52:03 user nova-compute[74646]:     </rng>
Oct 26 15:52:03 user nova-compute[74646]:   </devices>
Oct 26 15:52:03 user nova-compute[74646]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 15:52:03 user nova-compute[74646]:     <label>libvirt-8edad9e5-5649-4ac7-a885-ae2d85cfeafe</label>
Oct 26 15:52:03 user nova-compute[74646]:     <imagelabel>libvirt-8edad9e5-5649-4ac7-a885-ae2d85cfeafe</imagelabel>
Oct 26 15:52:03 user nova-compute[74646]:   </seclabel>
Oct 26 15:52:03 user nova-compute[74646]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 15:52:03 user nova-compute[74646]:     <label>+64055:+108</label>
Oct 26 15:52:03 user nova-compute[74646]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 15:52:03 user nova-compute[74646]:   </seclabel>
Oct 26 15:52:03 user nova-compute[74646]: </domain>
Oct 26 15:52:03 user nova-compute[74646]:  {{(pid=74646) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 15:52:03 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Successfully detached device tap80bebc53-31 from instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe from the persistent domain config.
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] (1/8): Attempting to detach device tap80bebc53-31 with device alias net1 from instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] detach device xml: <interface type="ethernet">
Oct 26 15:52:03 user nova-compute[74646]:   <mac address="fa:16:3e:82:84:7f"/>
Oct 26 15:52:03 user nova-compute[74646]:   <model type="virtio"/>
Oct 26 15:52:03 user nova-compute[74646]:   <mtu size="1442"/>
Oct 26 15:52:03 user nova-compute[74646]:   <target dev="tap80bebc53-31"/>
Oct 26 15:52:03 user nova-compute[74646]: </interface>
Oct 26 15:52:03 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] <== connect_volume: return (1366ms) {'type': 'block', 'scsi_wwn': '26632363539366132', 'path': '/dev/sdb'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632363539366132', 'path': '/dev/sdb'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.objects.instance [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lazy-loading 'flavor' on Instance uuid b8a97889-399d-46ec-ac9a-8d2db324ce69 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Start waiting for the detach event from libvirt for device tap80bebc53-31 with device alias net1 for instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.compute.manager [req-cb990876-f45c-4198-936c-4864bcdc4c8d req-77f75bcc-1284-43b7-8847-09690425fd50 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received event network-vif-unplugged-80bebc53-31f0-4b1e-8abb-50bf65fdbc16 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cb990876-f45c-4198-936c-4864bcdc4c8d req-77f75bcc-1284-43b7-8847-09690425fd50 service nova] Acquiring lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cb990876-f45c-4198-936c-4864bcdc4c8d req-77f75bcc-1284-43b7-8847-09690425fd50 service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cb990876-f45c-4198-936c-4864bcdc4c8d req-77f75bcc-1284-43b7-8847-09690425fd50 service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:03 user nova-compute[74646]: DEBUG nova.compute.manager [req-cb990876-f45c-4198-936c-4864bcdc4c8d req-77f75bcc-1284-43b7-8847-09690425fd50 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] No waiting events found dispatching network-vif-unplugged-80bebc53-31f0-4b1e-8abb-50bf65fdbc16 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:52:03 user nova-compute[74646]: WARNING nova.compute.manager [req-cb990876-f45c-4198-936c-4864bcdc4c8d req-77f75bcc-1284-43b7-8847-09690425fd50 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received unexpected event network-vif-unplugged-80bebc53-31f0-4b1e-8abb-50bf65fdbc16 for instance with vm_state active and task_state None.
Oct 26 15:52:04 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:04 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 75497472 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:04 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating instance_info_cache with network_info: [{"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cf56ceb-7a00-44df-8241-64aa699593d0", "address": "fa:16:3e:53:50:ad", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf56ceb-7a", "ovs_interfaceid": "0cf56ceb-7a00-44df-8241-64aa699593d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "address": "fa:16:3e:a9:06:78", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28218d89-be", "ovs_interfaceid": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Releasing lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:52:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Instance network_info: |[{"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cf56ceb-7a00-44df-8241-64aa699593d0", "address": "fa:16:3e:53:50:ad", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf56ceb-7a", "ovs_interfaceid": "0cf56ceb-7a00-44df-8241-64aa699593d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "address": "fa:16:3e:a9:06:78", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28218d89-be", "ovs_interfaceid": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:52:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] Acquired lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:52:04 user nova-compute[74646]: DEBUG nova.network.neutron [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing network info cache for port 9d77193f-b6bb-4a85-9380-d46735e5232b {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 176160768 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.network.neutron [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updated VIF entry in instance network info cache for port 9d77193f-b6bb-4a85-9380-d46735e5232b. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.network.neutron [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating instance_info_cache with network_info: [{"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cf56ceb-7a00-44df-8241-64aa699593d0", "address": "fa:16:3e:53:50:ad", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf56ceb-7a", "ovs_interfaceid": "0cf56ceb-7a00-44df-8241-64aa699593d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "address": "fa:16:3e:a9:06:78", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28218d89-be", "ovs_interfaceid": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] Releasing lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-changed-cbf3c1ca-d650-4636-938c-168459a271d8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing instance network info cache due to event network-changed-cbf3c1ca-d650-4636-938c-168459a271d8. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] Acquiring lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] Acquired lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.network.neutron [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing network info cache for port cbf3c1ca-d650-4636-938c-168459a271d8 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:52:05 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance be9a6bab-6958-43bb-9ed8-a531e05ed98d is timed out.
Oct 26 15:52:05 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Successfully detached device vdb from instance be9a6bab-6958-43bb-9ed8-a531e05ed98d from the live domain config.
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LZnadKhm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:52:05 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ecebee-f10e-4222-bef0-0c52dd8400d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:52:05 user nova-compute[74646]: No targets found.
Oct 26 15:52:05 user nova-compute[74646]: iSNS:
Oct 26 15:52:05 user nova-compute[74646]: No targets found.
Oct 26 15:52:05 user nova-compute[74646]: STATIC:
Oct 26 15:52:05 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a
Oct 26 15:52:05 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:52:05 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:52:05 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4
Oct 26 15:52:05 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:52:05 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:52:05 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e
Oct 26 15:52:05 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:52:05 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:52:05 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931
Oct 26 15:52:05 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:52:05 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:52:05 user nova-compute[74646]: FIRMWARE:
Oct 26 15:52:05 user nova-compute[74646]: No targets found.
Oct 26 15:52:05 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:52:05 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:52:05 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9643866a-8366-4637-b976-ea2c7e127489]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[40563e77-32ea-4b13-8d5a-9017e0b4a2ea]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:52:05 user nova-compute[74646]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)
Oct 26 15:52:05 user nova-compute[74646]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)
Oct 26 15:52:05 user nova-compute[74646]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)
Oct 26 15:52:05 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:52:05 user nova-compute[74646]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 (non-flash)
Oct 26 15:52:05 user nova-compute[74646]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)
Oct 26 15:52:05 user nova-compute[74646]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)
Oct 26 15:52:05 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e01fd900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4'): ({'sdc'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Removing single pathed devices sdc {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d66cefa-0d21-4d3f-93c9-39a45118de19]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d351b5-68fc-4a84-83a1-e9803f269559]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Flushing IO for device /dev/sdc {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd3be76-4add-4417-8485-d440d5c26cd3]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 301989888 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[667267d4-7161-406f-b2d4-4a0b9e0e1e0b]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1690d380-1328-49f3-9f0e-f9ed7665b267]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bf35f4-2280-4421-99e2-cab181e24a42]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4, portal: 172.16.0.220,3260]
Oct 26 15:52:05 user nova-compute[74646]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4, portal: 172.16.0.220,3260] successful.
Oct 26 15:52:05 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c3a665e-e29e-4a87-80e3-de831a1943a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4d34098-eb2b-4d5d-b9e2-c29d23746e6d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.478s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] <== disconnect_volume: return (479ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:52:05 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance 0c76f879-d140-484b-89ed-8d4012f44a7f is timed out.
Oct 26 15:52:05 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Successfully detached device sdc from instance 0c76f879-d140-484b-89ed-8d4012f44a7f from the live domain config.
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CBxuEymc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:52:05 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.network.neutron [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updated VIF entry in instance network info cache for port cbf3c1ca-d650-4636-938c-168459a271d8. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.network.neutron [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating instance_info_cache with network_info: [{"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cf56ceb-7a00-44df-8241-64aa699593d0", "address": "fa:16:3e:53:50:ad", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf56ceb-7a", "ovs_interfaceid": "0cf56ceb-7a00-44df-8241-64aa699593d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "address": "fa:16:3e:a9:06:78", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28218d89-be", "ovs_interfaceid": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d059287b-4b70-4f63-ab9a-038cb7283131]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:52:05 user nova-compute[74646]: No targets found.
Oct 26 15:52:05 user nova-compute[74646]: iSNS:
Oct 26 15:52:05 user nova-compute[74646]: No targets found.
Oct 26 15:52:05 user nova-compute[74646]: STATIC:
Oct 26 15:52:05 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a
Oct 26 15:52:05 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:52:05 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:52:05 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e
Oct 26 15:52:05 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:52:05 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:52:05 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931
Oct 26 15:52:05 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:52:05 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:52:05 user nova-compute[74646]: FIRMWARE:
Oct 26 15:52:05 user nova-compute[74646]: No targets found.
Oct 26 15:52:05 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:52:05 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:52:05 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] Releasing lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-changed-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing instance network info cache due to event network-changed-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] Acquiring lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] Acquired lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG nova.network.neutron [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing network info cache for port 28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9668c2-5535-4a1e-b014-90ab8bd144ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b4c11c-af19-4bc0-ac83-6e8392e6c0ea]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:52:05 user nova-compute[74646]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)
Oct 26 15:52:05 user nova-compute[74646]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)
Oct 26 15:52:05 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:52:05 user nova-compute[74646]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 (non-flash)
Oct 26 15:52:05 user nova-compute[74646]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)
Oct 26 15:52:05 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e01fd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931'): ({'sde'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Removing single pathed devices sde {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:52:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-88eb912d-d2a9-4b36-8a93-470affc10a64 req-ac332950-0e10-4a50-b50f-9de8aa84483d service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received event network-vif-plugged-80bebc53-31f0-4b1e-8abb-50bf65fdbc16 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-88eb912d-d2a9-4b36-8a93-470affc10a64 req-ac332950-0e10-4a50-b50f-9de8aa84483d service nova] Acquiring lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-88eb912d-d2a9-4b36-8a93-470affc10a64 req-ac332950-0e10-4a50-b50f-9de8aa84483d service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-88eb912d-d2a9-4b36-8a93-470affc10a64 req-ac332950-0e10-4a50-b50f-9de8aa84483d service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-88eb912d-d2a9-4b36-8a93-470affc10a64 req-ac332950-0e10-4a50-b50f-9de8aa84483d service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] No waiting events found dispatching network-vif-plugged-80bebc53-31f0-4b1e-8abb-50bf65fdbc16 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:52:06 user nova-compute[74646]: WARNING nova.compute.manager [req-88eb912d-d2a9-4b36-8a93-470affc10a64 req-ac332950-0e10-4a50-b50f-9de8aa84483d service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received unexpected event network-vif-plugged-80bebc53-31f0-4b1e-8abb-50bf65fdbc16 for instance with vm_state active and task_state None.
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b6a3a6-3358-4da8-812f-855c50dd7a45]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eb6dfb-f8eb-435f-b3fe-36819ca52d67]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Flushing IO for device /dev/sde {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[097a7498-9259-4b32-81c3-f1482b778a67]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9359c8e1-38a6-4249-83f3-49a842f3d95a]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] SCSI volumes sde have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b4c6cc-2178-47f6-adcc-267dbc642c0f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8be3e6-f200-4dd4-861b-f674984d37b1]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931, portal: 172.16.0.220,3260]
Oct 26 15:52:06 user nova-compute[74646]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931, portal: 172.16.0.220,3260] successful.
Oct 26 15:52:06 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 443547648 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c5a3b56c-4131-46b9-bd4c-d970c07c9931 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[349f8dc1-70d3-4044-8f71-3d9b97cda85f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] <== disconnect_volume: return (354ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG nova.network.neutron [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updated VIF entry in instance network info cache for port 28218d89-bed3-4eca-83fd-9fbbe8ddf7c9. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG nova.network.neutron [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating instance_info_cache with network_info: [{"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cf56ceb-7a00-44df-8241-64aa699593d0", "address": "fa:16:3e:53:50:ad", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf56ceb-7a", "ovs_interfaceid": "0cf56ceb-7a00-44df-8241-64aa699593d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "address": "fa:16:3e:a9:06:78", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28218d89-be", "ovs_interfaceid": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dc9e4880-d0ef-4865-9279-8942529862e2 req-112394f9-1247-4720-b054-b7ecac2e68ee service nova] Releasing lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:52:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 580911104 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 654311424 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 682622976 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:08 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 819986432 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:08 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 924844032 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 1046478848 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ulwqvmXo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:52:10 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c70716-45b3-44b9-a12b-b9b284f44c66]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:52:10 user nova-compute[74646]: No targets found.
Oct 26 15:52:10 user nova-compute[74646]: iSNS:
Oct 26 15:52:10 user nova-compute[74646]: No targets found.
Oct 26 15:52:10 user nova-compute[74646]: STATIC:
Oct 26 15:52:10 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a
Oct 26 15:52:10 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:52:10 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:52:10 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e
Oct 26 15:52:10 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:52:10 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:52:10 user nova-compute[74646]: FIRMWARE:
Oct 26 15:52:10 user nova-compute[74646]: No targets found.
Oct 26 15:52:10 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:52:10 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:52:10 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[becef782-908b-48c2-84c1-9cad42d2e8e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[91234a29-7b42-49ec-bc0f-fecd2c2a675e]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:52:10 user nova-compute[74646]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)
Oct 26 15:52:10 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:52:10 user nova-compute[74646]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)
Oct 26 15:52:10 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e01fdea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e'): ({'sdd'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Removing single pathed devices sdd {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49bb1ec-8267-4235-926f-083e77d51dc2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2fca9f-6357-4a52-ba67-98fc863a0950]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Flushing IO for device /dev/sdd {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd94f08-b85a-419d-9ca3-b8c8700965b9]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4362e8-bba1-42d0-b4ea-3ec6af6e97ef]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c026cfdf-1702-40b7-bc89-3e09a05f405f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4395b19e-5a5d-4cfd-ace2-5c2e8b78d33b]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260]
Oct 26 15:52:10 user nova-compute[74646]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260] successful.
Oct 26 15:52:10 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a9cdd5a-7059-4605-9cc6-64a9af3a8d9f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] <== disconnect_volume: return (282ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:52:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:52:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:17 user nova-compute[74646]: DEBUG nova.objects.instance [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lazy-loading 'flavor' on Instance uuid 0c76f879-d140-484b-89ed-8d4012f44a7f {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:52:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2ba42697-d278-4eab-b17a-f84cb80e198b tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.127s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:17 user nova-compute[74646]: DEBUG nova.compute.manager [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HtRArpuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'b8a97889-399d-46ec-ac9a-8d2db324ce69', 'attached_at': '', 'detached_at': '', 'volume_id': '6f434a4a-7fc0-4202-a626-c63a0c54769a', 'serial'} {{(pid=74646) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 26 15:52:17 user nova-compute[74646]: DEBUG nova.compute.manager [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] swap_volume: removing Cinder connection for volume b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e {{(pid=74646) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 26 15:52:17 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:52:17 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:52:17 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:52:17 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:52:17 user nova-compute[74646]: INFO nova.virt.block_device [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Booting with volume e89b4d1b-224d-4b00-b83c-1190338c8eae at /dev/vdb
Oct 26 15:52:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-0c76f879-d140-484b-89ed-8d4012f44a7f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:52:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-0c76f879-d140-484b-89ed-8d4012f44a7f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:52:17 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Updating instance_info_cache with network_info: [{"id": "2a89712c-1508-4385-941b-b8bea7de3c35", "address": "fa:16:3e:51:bc:da", "network": {"id": "99cf3989-5b18-4c8f-82f2-719e0019fe32", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-341987946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8efc31ce8cd746c2b17e13aee9014810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a89712c-15", "ovs_interfaceid": "2a89712c-1508-4385-941b-b8bea7de3c35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-0c76f879-d140-484b-89ed-8d4012f44a7f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG nova.compute.manager [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] swap_volume: Updating volume b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "HtRArpuO", "auth_password": "DR3rV4hk1UBqNp", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "6f434a4a-7fc0-4202-a626-c63a0c54769a"}, "status": "reserved", "instance": "b8a97889-399d-46ec-ac9a-8d2db324ce69", "attached_at": "", "detached_at": "", "volume_id": "6f434a4a-7fc0-4202-a626-c63a0c54769a", "serial": "6f434a4a-7fc0-4202-a626-c63a0c54769a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '6f434a4a-7fc0-4202-a626-c63a0c54769a', 'no_device': None, 'attachment_id': '7ee3ee72-5c75-44b2-a315-664556247710'} {{(pid=74646) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-26adda4a-62f3-40fd-a2ac-7fa42c4ec6a0 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 39.627s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG os_brick.utils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7a0155-c9cc-4a27-a346-cf7ef6c5e88d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b4852b-4da2-4732-b3f9-a1adc5abc050]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdcb7e11-43b9-4cba-b324-08d31df53254]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cf33f6-5df0-467a-bd9a-c382e0bad491]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:52:18 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c3817b-7db3-481f-9118-cdd5f47504e0]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG os_brick.utils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating existing volume attachment record: 2900e285-434b-417a-b51e-311d2a0ae658 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:52:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "0c76f879-d140-484b-89ed-8d4012f44a7f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:19 user nova-compute[74646]: INFO nova.compute.manager [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Terminating instance
Oct 26 15:52:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-e3c17c38-3689-4c43-a446-f36a08162751 req-8b48ff3f-97dd-48f6-9f73-bfcbeef1911d service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Received event network-vif-unplugged-2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e3c17c38-3689-4c43-a446-f36a08162751 req-8b48ff3f-97dd-48f6-9f73-bfcbeef1911d service nova] Acquiring lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e3c17c38-3689-4c43-a446-f36a08162751 req-8b48ff3f-97dd-48f6-9f73-bfcbeef1911d service nova] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e3c17c38-3689-4c43-a446-f36a08162751 req-8b48ff3f-97dd-48f6-9f73-bfcbeef1911d service nova] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-e3c17c38-3689-4c43-a446-f36a08162751 req-8b48ff3f-97dd-48f6-9f73-bfcbeef1911d service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] No waiting events found dispatching network-vif-unplugged-2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-e3c17c38-3689-4c43-a446-f36a08162751 req-8b48ff3f-97dd-48f6-9f73-bfcbeef1911d service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Received event network-vif-unplugged-2a89712c-1508-4385-941b-b8bea7de3c35 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:19 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Instance destroyed successfully.
Oct 26 15:52:19 user nova-compute[74646]: DEBUG nova.objects.instance [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lazy-loading 'resources' on Instance uuid 0c76f879-d140-484b-89ed-8d4012f44a7f {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:48:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1676663822',display_name='tempest-AttachSCSIVolumeTestJSON-server-1676663822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1676663822',id=4,image_ref='51064f1f-0962-4845-b994-96520ef9f2ee',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBz/nBxtRdUl8eOJ5U4NfLmocwlMKHBcNdgJqvDFCr7HPujSsXX1Y9MtFaFXWFR1I3fbWSjlGlVfsZ1ruASV6GcyBpto4uer29ps785s1ff1kH4h5CpdyW7z3oCttVoYXA==',key_name='tempest-keypair-847108979',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:48:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8efc31ce8cd746c2b17e13aee9014810',ramdisk_id='',reservation_id='r-eu9kavcz',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='51064f1f-0962-4845-b994-96520ef9f2ee',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1961026020',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1961026020-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:48:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d1e8f58ce51848e8a2824c1f5fe44cc4',uuid=0c76f879-d140-484b-89ed-8d4012f44a7f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a89712c-1508-4385-941b-b8bea7de3c35", "address": "fa:16:3e:51:bc:da", "network": {"id": "99cf3989-5b18-4c8f-82f2-719e0019fe32", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-341987946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8efc31ce8cd746c2b17e13aee9014810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a89712c-15", "ovs_interfaceid": "2a89712c-1508-4385-941b-b8bea7de3c35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Converting VIF {"id": "2a89712c-1508-4385-941b-b8bea7de3c35", "address": "fa:16:3e:51:bc:da", "network": {"id": "99cf3989-5b18-4c8f-82f2-719e0019fe32", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-341987946-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8efc31ce8cd746c2b17e13aee9014810", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a89712c-15", "ovs_interfaceid": "2a89712c-1508-4385-941b-b8bea7de3c35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:51:bc:da,bridge_name='br-int',has_traffic_filtering=True,id=2a89712c-1508-4385-941b-b8bea7de3c35,network=Network(99cf3989-5b18-4c8f-82f2-719e0019fe32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a89712c-15') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG os_vif [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:bc:da,bridge_name='br-int',has_traffic_filtering=True,id=2a89712c-1508-4385-941b-b8bea7de3c35,network=Network(99cf3989-5b18-4c8f-82f2-719e0019fe32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a89712c-15') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a89712c-15, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c32e0323-6fd7-43ff-b64a-7a9cedf257a8) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:19 user nova-compute[74646]: INFO os_vif [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:51:bc:da,bridge_name='br-int',has_traffic_filtering=True,id=2a89712c-1508-4385-941b-b8bea7de3c35,network=Network(99cf3989-5b18-4c8f-82f2-719e0019fe32),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a89712c-15')
Oct 26 15:52:19 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Deleting instance files /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f_del
Oct 26 15:52:19 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Deletion of /opt/stack/data/nova/instances/0c76f879-d140-484b-89ed-8d4012f44a7f_del complete
Oct 26 15:52:20 user nova-compute[74646]: INFO nova.compute.manager [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 26 15:52:20 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 15:52:20 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 15:52:20 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 15:52:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:20 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:20 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Took 0.89 seconds to deallocate network for instance.
Oct 26 15:52:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:21 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Deleted allocations for instance 0c76f879-d140-484b-89ed-8d4012f44a7f
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-421299a8-974e-4bbd-9871-9e8d14bc4a3d req-49e331fa-7b4e-4a84-a354-b017e5945aac service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Received event network-vif-plugged-2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-421299a8-974e-4bbd-9871-9e8d14bc4a3d req-49e331fa-7b4e-4a84-a354-b017e5945aac service nova] Acquiring lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-421299a8-974e-4bbd-9871-9e8d14bc4a3d req-49e331fa-7b4e-4a84-a354-b017e5945aac service nova] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-421299a8-974e-4bbd-9871-9e8d14bc4a3d req-49e331fa-7b4e-4a84-a354-b017e5945aac service nova] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-421299a8-974e-4bbd-9871-9e8d14bc4a3d req-49e331fa-7b4e-4a84-a354-b017e5945aac service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] No waiting events found dispatching network-vif-plugged-2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:52:21 user nova-compute[74646]: WARNING nova.compute.manager [req-421299a8-974e-4bbd-9871-9e8d14bc4a3d req-49e331fa-7b4e-4a84-a354-b017e5945aac service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Received unexpected event network-vif-plugged-2a89712c-1508-4385-941b-b8bea7de3c35 for instance with vm_state deleted and task_state None.
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-421299a8-974e-4bbd-9871-9e8d14bc4a3d req-49e331fa-7b4e-4a84-a354-b017e5945aac service nova] [instance: 0c76f879-d140-484b-89ed-8d4012f44a7f] Received event network-vif-deleted-2a89712c-1508-4385-941b-b8bea7de3c35 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:21 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:52:21 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8116MB free_disk=25.62995147705078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e0ae4a15-1499-4775-94f0-6866cb221817 tempest-AttachSCSIVolumeTestJSON-1961026020 tempest-AttachSCSIVolumeTestJSON-1961026020-project-member] Lock "0c76f879-d140-484b-89ed-8d4012f44a7f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.748s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1c5d5313-72f0-4f49-83b7-f277d5da4191 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 5e42f38e-e10f-43b7-89ab-ab22addfcf95 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance be9a6bab-6958-43bb-9ed8-a531e05ed98d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b8a97889-399d-46ec-ac9a-8d2db324ce69 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance e8268040-8dbe-4320-94e9-f6cdaf4eb157 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance ea252f48-c697-445e-bfc8-4a919b23aa83 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:52:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:52:22 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:52:22 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:52:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:52:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.384s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:23 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Waiting for libvirt event about the detach of device tap80bebc53-31 with device alias net1 from instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe is timed out.
Oct 26 15:52:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:82:84:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap80bebc53-31"/></interface> {{(pid=74646) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 15:52:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:82:84:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap80bebc53-31"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 26 15:52:23 user nova-compute[74646]:   <name>instance-00000006</name>
Oct 26 15:52:23 user nova-compute[74646]:   <uuid>8edad9e5-5649-4ac7-a885-ae2d85cfeafe</uuid>
Oct 26 15:52:23 user nova-compute[74646]:   <metadata>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:52:23 user nova-compute[74646]:   <nova:package version="0.0.0"/>
Oct 26 15:52:23 user nova-compute[74646]:   <nova:name>tempest-device-tagging-server-109261951</nova:name>
Oct 26 15:52:23 user nova-compute[74646]:   <nova:creationTime>2023-10-26 15:50:54</nova:creationTime>
Oct 26 15:52:23 user nova-compute[74646]:   <nova:flavor name="m1.tiny">
Oct 26 15:52:23 user nova-compute[74646]:     <nova:memory>512</nova:memory>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:disk>1</nova:disk>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:swap>0</nova:swap>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:vcpus>1</nova:vcpus>
Oct 26 15:52:23 user nova-compute[74646]:   </nova:flavor>
Oct 26 15:52:23 user nova-compute[74646]:   <nova:owner>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:user uuid="723b9bbed73446b29f877a87c48234fe">tempest-TaggedAttachmentsTest-180887235-project-member</nova:user>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:project uuid="c2d636dad453466192a545f54098b6ef">tempest-TaggedAttachmentsTest-180887235</nova:project>
Oct 26 15:52:23 user nova-compute[74646]:   </nova:owner>
Oct 26 15:52:23 user nova-compute[74646]:   <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:52:23 user nova-compute[74646]:   <nova:ports>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:port uuid="c03623fa-065f-47ad-9127-5fdebf97a32d">
Oct 26 15:52:23 user nova-compute[74646]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 15:52:23 user nova-compute[74646]:     </nova:port>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:port uuid="80bebc53-31f0-4b1e-8abb-50bf65fdbc16">
Oct 26 15:52:23 user nova-compute[74646]:       <nova:ip type="fixed" address="10.10.10.215" ipVersion="4"/>
Oct 26 15:52:23 user nova-compute[74646]:     </nova:port>
Oct 26 15:52:23 user nova-compute[74646]:   </nova:ports>
Oct 26 15:52:23 user nova-compute[74646]: </nova:instance>
Oct 26 15:52:23 user nova-compute[74646]:   </metadata>
Oct 26 15:52:23 user nova-compute[74646]:   <memory unit='KiB'>524288</memory>
Oct 26 15:52:23 user nova-compute[74646]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 15:52:23 user nova-compute[74646]:   <vcpu placement='static'>1</vcpu>
Oct 26 15:52:23 user nova-compute[74646]:   <resource>
Oct 26 15:52:23 user nova-compute[74646]:     <partition>/machine</partition>
Oct 26 15:52:23 user nova-compute[74646]:   </resource>
Oct 26 15:52:23 user nova-compute[74646]:   <sysinfo type='smbios'>
Oct 26 15:52:23 user nova-compute[74646]:     <system>
Oct 26 15:52:23 user nova-compute[74646]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 15:52:23 user nova-compute[74646]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 15:52:23 user nova-compute[74646]:       <entry name='version'>0.0.0</entry>
Oct 26 15:52:23 user nova-compute[74646]:       <entry name='serial'>8edad9e5-5649-4ac7-a885-ae2d85cfeafe</entry>
Oct 26 15:52:23 user nova-compute[74646]:       <entry name='uuid'>8edad9e5-5649-4ac7-a885-ae2d85cfeafe</entry>
Oct 26 15:52:23 user nova-compute[74646]:       <entry name='family'>Virtual Machine</entry>
Oct 26 15:52:23 user nova-compute[74646]:     </system>
Oct 26 15:52:23 user nova-compute[74646]:   </sysinfo>
Oct 26 15:52:23 user nova-compute[74646]:   <os>
Oct 26 15:52:23 user nova-compute[74646]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 15:52:23 user nova-compute[74646]:     <boot dev='hd'/>
Oct 26 15:52:23 user nova-compute[74646]:     <smbios mode='sysinfo'/>
Oct 26 15:52:23 user nova-compute[74646]:   </os>
Oct 26 15:52:23 user nova-compute[74646]:   <features>
Oct 26 15:52:23 user nova-compute[74646]:     <acpi/>
Oct 26 15:52:23 user nova-compute[74646]:     <apic/>
Oct 26 15:52:23 user nova-compute[74646]:     <vmcoreinfo state='on'/>
Oct 26 15:52:23 user nova-compute[74646]:   </features>
Oct 26 15:52:23 user nova-compute[74646]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 15:52:23 user nova-compute[74646]:     <model fallback='forbid'>Nehalem</model>
Oct 26 15:52:23 user nova-compute[74646]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 15:52:23 user nova-compute[74646]:     <feature policy='require' name='vme'/>
Oct 26 15:52:23 user nova-compute[74646]:     <feature policy='require' name='x2apic'/>
Oct 26 15:52:23 user nova-compute[74646]:     <feature policy='require' name='hypervisor'/>
Oct 26 15:52:23 user nova-compute[74646]:   </cpu>
Oct 26 15:52:23 user nova-compute[74646]:   <clock offset='utc'>
Oct 26 15:52:23 user nova-compute[74646]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 15:52:23 user nova-compute[74646]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 15:52:23 user nova-compute[74646]:     <timer name='hpet' present='no'/>
Oct 26 15:52:23 user nova-compute[74646]:   </clock>
Oct 26 15:52:23 user nova-compute[74646]:   <on_poweroff>destroy</on_poweroff>
Oct 26 15:52:23 user nova-compute[74646]:   <on_reboot>restart</on_reboot>
Oct 26 15:52:23 user nova-compute[74646]:   <on_crash>destroy</on_crash>
Oct 26 15:52:23 user nova-compute[74646]:   <devices>
Oct 26 15:52:23 user nova-compute[74646]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 15:52:23 user nova-compute[74646]:     <disk type='file' device='disk'>
Oct 26 15:52:23 user nova-compute[74646]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 15:52:23 user nova-compute[74646]:       <source file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk' index='2'/>
Oct 26 15:52:23 user nova-compute[74646]:       <backingStore type='file' index='3'>
Oct 26 15:52:23 user nova-compute[74646]:         <format type='raw'/>
Oct 26 15:52:23 user nova-compute[74646]:         <source file='/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7'/>
Oct 26 15:52:23 user nova-compute[74646]:         <backingStore/>
Oct 26 15:52:23 user nova-compute[74646]:       </backingStore>
Oct 26 15:52:23 user nova-compute[74646]:       <target dev='vda' bus='virtio'/>
Oct 26 15:52:23 user nova-compute[74646]:       <alias name='virtio-disk0'/>
Oct 26 15:52:23 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 15:52:23 user nova-compute[74646]:     </disk>
Oct 26 15:52:23 user nova-compute[74646]:     <disk type='file' device='cdrom'>
Oct 26 15:52:23 user nova-compute[74646]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 15:52:23 user nova-compute[74646]:       <source file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk.config' index='1'/>
Oct 26 15:52:23 user nova-compute[74646]:       <backingStore/>
Oct 26 15:52:23 user nova-compute[74646]:       <target dev='hda' bus='ide'/>
Oct 26 15:52:23 user nova-compute[74646]:       <readonly/>
Oct 26 15:52:23 user nova-compute[74646]:       <alias name='ide0-0-0'/>
Oct 26 15:52:23 user nova-compute[74646]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 15:52:23 user nova-compute[74646]:     </disk>
Oct 26 15:52:23 user nova-compute[74646]:     <controller type='usb' index='0' model='none'>
Oct 26 15:52:23 user nova-compute[74646]:       <alias name='usb'/>
Oct 26 15:52:23 user nova-compute[74646]:     </controller>
Oct 26 15:52:23 user nova-compute[74646]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 15:52:23 user nova-compute[74646]:       <alias name='pci.0'/>
Oct 26 15:52:23 user nova-compute[74646]:     </controller>
Oct 26 15:52:23 user nova-compute[74646]:     <controller type='ide' index='0'>
Oct 26 15:52:23 user nova-compute[74646]:       <alias name='ide'/>
Oct 26 15:52:23 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 15:52:23 user nova-compute[74646]:     </controller>
Oct 26 15:52:23 user nova-compute[74646]:     <interface type='ethernet'>
Oct 26 15:52:23 user nova-compute[74646]:       <mac address='fa:16:3e:e2:d4:d9'/>
Oct 26 15:52:23 user nova-compute[74646]:       <target dev='tapc03623fa-06'/>
Oct 26 15:52:23 user nova-compute[74646]:       <model type='virtio'/>
Oct 26 15:52:23 user nova-compute[74646]:       <mtu size='1442'/>
Oct 26 15:52:23 user nova-compute[74646]:       <alias name='net0'/>
Oct 26 15:52:23 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 15:52:23 user nova-compute[74646]:     </interface>
Oct 26 15:52:23 user nova-compute[74646]:     <serial type='pty'>
Oct 26 15:52:23 user nova-compute[74646]:       <source path='/dev/pts/5'/>
Oct 26 15:52:23 user nova-compute[74646]:       <log file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/console.log' append='off'/>
Oct 26 15:52:23 user nova-compute[74646]:       <target type='isa-serial' port='0'>
Oct 26 15:52:23 user nova-compute[74646]:         <model name='isa-serial'/>
Oct 26 15:52:23 user nova-compute[74646]:       </target>
Oct 26 15:52:23 user nova-compute[74646]:       <alias name='serial0'/>
Oct 26 15:52:23 user nova-compute[74646]:     </serial>
Oct 26 15:52:23 user nova-compute[74646]:     <console type='pty' tty='/dev/pts/5'>
Oct 26 15:52:23 user nova-compute[74646]:       <source path='/dev/pts/5'/>
Oct 26 15:52:23 user nova-compute[74646]:       <log file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/console.log' append='off'/>
Oct 26 15:52:23 user nova-compute[74646]:       <target type='serial' port='0'/>
Oct 26 15:52:23 user nova-compute[74646]:       <alias name='serial0'/>
Oct 26 15:52:23 user nova-compute[74646]:     </console>
Oct 26 15:52:23 user nova-compute[74646]:     <input type='mouse' bus='ps2'>
Oct 26 15:52:23 user nova-compute[74646]:       <alias name='input0'/>
Oct 26 15:52:23 user nova-compute[74646]:     </input>
Oct 26 15:52:23 user nova-compute[74646]:     <input type='keyboard' bus='ps2'>
Oct 26 15:52:23 user nova-compute[74646]:       <alias name='input1'/>
Oct 26 15:52:23 user nova-compute[74646]:     </input>
Oct 26 15:52:23 user nova-compute[74646]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 26 15:52:23 user nova-compute[74646]:       <listen type='address' address='0.0.0.0'/>
Oct 26 15:52:23 user nova-compute[74646]:     </graphics>
Oct 26 15:52:23 user nova-compute[74646]:     <audio id='1' type='none'/>
Oct 26 15:52:23 user nova-compute[74646]:     <video>
Oct 26 15:52:23 user nova-compute[74646]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 15:52:23 user nova-compute[74646]:       <alias name='video0'/>
Oct 26 15:52:23 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 15:52:23 user nova-compute[74646]:     </video>
Oct 26 15:52:23 user nova-compute[74646]:     <memballoon model='virtio'>
Oct 26 15:52:23 user nova-compute[74646]:       <stats period='10'/>
Oct 26 15:52:23 user nova-compute[74646]:       <alias name='balloon0'/>
Oct 26 15:52:23 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 15:52:23 user nova-compute[74646]:     </memballoon>
Oct 26 15:52:23 user nova-compute[74646]:     <rng model='virtio'>
Oct 26 15:52:23 user nova-compute[74646]:       <backend model='random'>/dev/urandom</backend>
Oct 26 15:52:23 user nova-compute[74646]:       <alias name='rng0'/>
Oct 26 15:52:23 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 15:52:23 user nova-compute[74646]:     </rng>
Oct 26 15:52:23 user nova-compute[74646]:   </devices>
Oct 26 15:52:23 user nova-compute[74646]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 15:52:23 user nova-compute[74646]:     <label>libvirt-8edad9e5-5649-4ac7-a885-ae2d85cfeafe</label>
Oct 26 15:52:23 user nova-compute[74646]:     <imagelabel>libvirt-8edad9e5-5649-4ac7-a885-ae2d85cfeafe</imagelabel>
Oct 26 15:52:23 user nova-compute[74646]:   </seclabel>
Oct 26 15:52:23 user nova-compute[74646]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 15:52:23 user nova-compute[74646]:     <label>+64055:+108</label>
Oct 26 15:52:23 user nova-compute[74646]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 15:52:23 user nova-compute[74646]:   </seclabel>
Oct 26 15:52:23 user nova-compute[74646]: </domain>
Oct 26 15:52:23 user nova-compute[74646]:  {{(pid=74646) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 15:52:23 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Successfully detached device tap80bebc53-31 from instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe from the live domain config.
Oct 26 15:52:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-109261951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-109261951',id=6,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORFY2BSLaMhq/E5p+UHLBw9zanVj3hPYzpAhpE2tuRkW9nT+9656pE9yOGjFfMafxl/9w7KQhKQ7j+X841AaJHigdfvo2GKz6ua9+kNxAcYmgo0FYMnOu5s42XAwkFHvw==',key_name='tempest-keypair-1091666697',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2d636dad453466192a545f54098b6ef',ramdisk_id='',reservation_id='r-2mi45cco',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-180887235',owner_user_name='tempest-TaggedAttachmentsTest-180887235-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:49:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='723b9bbed73446b29f877a87c48234fe',uuid=8edad9e5-5649-4ac7-a885-ae2d85cfeafe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "address": "fa:16:3e:82:84:7f", "network": {"id": "8f104fed-08e3-4de9-b66a-7fe8c239c70f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2031322880", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bebc53-31", "ovs_interfaceid": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:52:23 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Converting VIF {"id": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "address": "fa:16:3e:82:84:7f", "network": {"id": "8f104fed-08e3-4de9-b66a-7fe8c239c70f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2031322880", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bebc53-31", "ovs_interfaceid": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:52:23 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7f,bridge_name='br-int',has_traffic_filtering=True,id=80bebc53-31f0-4b1e-8abb-50bf65fdbc16,network=Network(8f104fed-08e3-4de9-b66a-7fe8c239c70f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bebc53-31') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:52:23 user nova-compute[74646]: DEBUG os_vif [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7f,bridge_name='br-int',has_traffic_filtering=True,id=80bebc53-31f0-4b1e-8abb-50bf65fdbc16,network=Network(8f104fed-08e3-4de9-b66a-7fe8c239c70f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bebc53-31') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:52:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80bebc53-31, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:52:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:52:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ac9cc936-04d5-4fc3-a741-8ba223c729a9) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:52:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:23 user nova-compute[74646]: INFO os_vif [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7f,bridge_name='br-int',has_traffic_filtering=True,id=80bebc53-31f0-4b1e-8abb-50bf65fdbc16,network=Network(8f104fed-08e3-4de9-b66a-7fe8c239c70f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bebc53-31')
Oct 26 15:52:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:52:23 user nova-compute[74646]:   <nova:package version="0.0.0"/>
Oct 26 15:52:23 user nova-compute[74646]:   <nova:name>tempest-device-tagging-server-109261951</nova:name>
Oct 26 15:52:23 user nova-compute[74646]:   <nova:creationTime>2023-10-26 15:52:23</nova:creationTime>
Oct 26 15:52:23 user nova-compute[74646]:   <nova:flavor name="m1.tiny">
Oct 26 15:52:23 user nova-compute[74646]:     <nova:memory>512</nova:memory>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:disk>1</nova:disk>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:swap>0</nova:swap>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:vcpus>1</nova:vcpus>
Oct 26 15:52:23 user nova-compute[74646]:   </nova:flavor>
Oct 26 15:52:23 user nova-compute[74646]:   <nova:owner>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:user uuid="723b9bbed73446b29f877a87c48234fe">tempest-TaggedAttachmentsTest-180887235-project-member</nova:user>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:project uuid="c2d636dad453466192a545f54098b6ef">tempest-TaggedAttachmentsTest-180887235</nova:project>
Oct 26 15:52:23 user nova-compute[74646]:   </nova:owner>
Oct 26 15:52:23 user nova-compute[74646]:   <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:52:23 user nova-compute[74646]:   <nova:ports>
Oct 26 15:52:23 user nova-compute[74646]:     <nova:port uuid="c03623fa-065f-47ad-9127-5fdebf97a32d">
Oct 26 15:52:23 user nova-compute[74646]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 15:52:23 user nova-compute[74646]:     </nova:port>
Oct 26 15:52:23 user nova-compute[74646]:   </nova:ports>
Oct 26 15:52:23 user nova-compute[74646]: </nova:instance>
Oct 26 15:52:23 user nova-compute[74646]:  {{(pid=74646) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.compute.manager [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received event network-vif-deleted-80bebc53-31f0-4b1e-8abb-50bf65fdbc16 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:24 user nova-compute[74646]: INFO nova.compute.manager [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Neutron deleted interface 80bebc53-31f0-4b1e-8abb-50bf65fdbc16; detaching it from the instance and deleting it from the info cache
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.network.neutron [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Updating instance_info_cache with network_info: [{"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquired lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.objects.instance [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] Lazy-loading 'system_metadata' on Instance uuid 8edad9e5-5649-4ac7-a885-ae2d85cfeafe {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.objects.instance [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lazy-loading 'flavor' on Instance uuid be9a6bab-6958-43bb-9ed8-a531e05ed98d {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.objects.instance [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] Lazy-loading 'flavor' on Instance uuid 8edad9e5-5649-4ac7-a885-ae2d85cfeafe {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.objects.base [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] Object Instance<8edad9e5-5649-4ac7-a885-ae2d85cfeafe> lazy-loaded attributes: system_metadata,flavor {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-109261951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-109261951',id=6,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORFY2BSLaMhq/E5p+UHLBw9zanVj3hPYzpAhpE2tuRkW9nT+9656pE9yOGjFfMafxl/9w7KQhKQ7j+X841AaJHigdfvo2GKz6ua9+kNxAcYmgo0FYMnOu5s42XAwkFHvw==',key_name='tempest-keypair-1091666697',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2d636dad453466192a545f54098b6ef',ramdisk_id='',reservation_id='r-2mi45cco',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-180887235',owner_user_name='tempest-TaggedAttachmentsTest-180887235-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:49:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='723b9bbed73446b29f877a87c48234fe',uuid=8edad9e5-5649-4ac7-a885-ae2d85cfeafe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "address": "fa:16:3e:82:84:7f", "network": {"id": "8f104fed-08e3-4de9-b66a-7fe8c239c70f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2031322880", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bebc53-31", "ovs_interfaceid": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.network.os_vif_util [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] Converting VIF {"id": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "address": "fa:16:3e:82:84:7f", "network": {"id": "8f104fed-08e3-4de9-b66a-7fe8c239c70f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2031322880", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bebc53-31", "ovs_interfaceid": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.network.os_vif_util [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7f,bridge_name='br-int',has_traffic_filtering=True,id=80bebc53-31f0-4b1e-8abb-50bf65fdbc16,network=Network(8f104fed-08e3-4de9-b66a-7fe8c239c70f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bebc53-31') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c0384062-aabc-4226-98d2-3af79ace0590 tempest-VolumesAssistedSnapshotsTest-368858613 tempest-VolumesAssistedSnapshotsTest-368858613-project-admin] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 39.926s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:82:84:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap80bebc53-31"/></interface> {{(pid=74646) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:82:84:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap80bebc53-31"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 26 15:52:24 user nova-compute[74646]:   <name>instance-00000006</name>
Oct 26 15:52:24 user nova-compute[74646]:   <uuid>8edad9e5-5649-4ac7-a885-ae2d85cfeafe</uuid>
Oct 26 15:52:24 user nova-compute[74646]:   <metadata>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:52:24 user nova-compute[74646]:   <nova:package version="0.0.0"/>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:name>tempest-device-tagging-server-109261951</nova:name>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:creationTime>2023-10-26 15:52:23</nova:creationTime>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:flavor name="m1.tiny">
Oct 26 15:52:24 user nova-compute[74646]:     <nova:memory>512</nova:memory>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:disk>1</nova:disk>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:swap>0</nova:swap>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:vcpus>1</nova:vcpus>
Oct 26 15:52:24 user nova-compute[74646]:   </nova:flavor>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:owner>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:user uuid="723b9bbed73446b29f877a87c48234fe">tempest-TaggedAttachmentsTest-180887235-project-member</nova:user>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:project uuid="c2d636dad453466192a545f54098b6ef">tempest-TaggedAttachmentsTest-180887235</nova:project>
Oct 26 15:52:24 user nova-compute[74646]:   </nova:owner>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:ports>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:port uuid="c03623fa-065f-47ad-9127-5fdebf97a32d">
Oct 26 15:52:24 user nova-compute[74646]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 15:52:24 user nova-compute[74646]:     </nova:port>
Oct 26 15:52:24 user nova-compute[74646]:   </nova:ports>
Oct 26 15:52:24 user nova-compute[74646]: </nova:instance>
Oct 26 15:52:24 user nova-compute[74646]:   </metadata>
Oct 26 15:52:24 user nova-compute[74646]:   <memory unit='KiB'>524288</memory>
Oct 26 15:52:24 user nova-compute[74646]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 15:52:24 user nova-compute[74646]:   <vcpu placement='static'>1</vcpu>
Oct 26 15:52:24 user nova-compute[74646]:   <resource>
Oct 26 15:52:24 user nova-compute[74646]:     <partition>/machine</partition>
Oct 26 15:52:24 user nova-compute[74646]:   </resource>
Oct 26 15:52:24 user nova-compute[74646]:   <sysinfo type='smbios'>
Oct 26 15:52:24 user nova-compute[74646]:     <system>
Oct 26 15:52:24 user nova-compute[74646]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 15:52:24 user nova-compute[74646]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 15:52:24 user nova-compute[74646]:       <entry name='version'>0.0.0</entry>
Oct 26 15:52:24 user nova-compute[74646]:       <entry name='serial'>8edad9e5-5649-4ac7-a885-ae2d85cfeafe</entry>
Oct 26 15:52:24 user nova-compute[74646]:       <entry name='uuid'>8edad9e5-5649-4ac7-a885-ae2d85cfeafe</entry>
Oct 26 15:52:24 user nova-compute[74646]:       <entry name='family'>Virtual Machine</entry>
Oct 26 15:52:24 user nova-compute[74646]:     </system>
Oct 26 15:52:24 user nova-compute[74646]:   </sysinfo>
Oct 26 15:52:24 user nova-compute[74646]:   <os>
Oct 26 15:52:24 user nova-compute[74646]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 15:52:24 user nova-compute[74646]:     <boot dev='hd'/>
Oct 26 15:52:24 user nova-compute[74646]:     <smbios mode='sysinfo'/>
Oct 26 15:52:24 user nova-compute[74646]:   </os>
Oct 26 15:52:24 user nova-compute[74646]:   <features>
Oct 26 15:52:24 user nova-compute[74646]:     <acpi/>
Oct 26 15:52:24 user nova-compute[74646]:     <apic/>
Oct 26 15:52:24 user nova-compute[74646]:     <vmcoreinfo state='on'/>
Oct 26 15:52:24 user nova-compute[74646]:   </features>
Oct 26 15:52:24 user nova-compute[74646]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 15:52:24 user nova-compute[74646]:     <model fallback='forbid'>Nehalem</model>
Oct 26 15:52:24 user nova-compute[74646]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 15:52:24 user nova-compute[74646]:     <feature policy='require' name='vme'/>
Oct 26 15:52:24 user nova-compute[74646]:     <feature policy='require' name='x2apic'/>
Oct 26 15:52:24 user nova-compute[74646]:     <feature policy='require' name='hypervisor'/>
Oct 26 15:52:24 user nova-compute[74646]:   </cpu>
Oct 26 15:52:24 user nova-compute[74646]:   <clock offset='utc'>
Oct 26 15:52:24 user nova-compute[74646]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 15:52:24 user nova-compute[74646]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 15:52:24 user nova-compute[74646]:     <timer name='hpet' present='no'/>
Oct 26 15:52:24 user nova-compute[74646]:   </clock>
Oct 26 15:52:24 user nova-compute[74646]:   <on_poweroff>destroy</on_poweroff>
Oct 26 15:52:24 user nova-compute[74646]:   <on_reboot>restart</on_reboot>
Oct 26 15:52:24 user nova-compute[74646]:   <on_crash>destroy</on_crash>
Oct 26 15:52:24 user nova-compute[74646]:   <devices>
Oct 26 15:52:24 user nova-compute[74646]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 15:52:24 user nova-compute[74646]:     <disk type='file' device='disk'>
Oct 26 15:52:24 user nova-compute[74646]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 15:52:24 user nova-compute[74646]:       <source file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk' index='2'/>
Oct 26 15:52:24 user nova-compute[74646]:       <backingStore type='file' index='3'>
Oct 26 15:52:24 user nova-compute[74646]:         <format type='raw'/>
Oct 26 15:52:24 user nova-compute[74646]:         <source file='/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7'/>
Oct 26 15:52:24 user nova-compute[74646]:         <backingStore/>
Oct 26 15:52:24 user nova-compute[74646]:       </backingStore>
Oct 26 15:52:24 user nova-compute[74646]:       <target dev='vda' bus='virtio'/>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='virtio-disk0'/>
Oct 26 15:52:24 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </disk>
Oct 26 15:52:24 user nova-compute[74646]:     <disk type='file' device='cdrom'>
Oct 26 15:52:24 user nova-compute[74646]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 15:52:24 user nova-compute[74646]:       <source file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk.config' index='1'/>
Oct 26 15:52:24 user nova-compute[74646]:       <backingStore/>
Oct 26 15:52:24 user nova-compute[74646]:       <target dev='hda' bus='ide'/>
Oct 26 15:52:24 user nova-compute[74646]:       <readonly/>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='ide0-0-0'/>
Oct 26 15:52:24 user nova-compute[74646]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </disk>
Oct 26 15:52:24 user nova-compute[74646]:     <controller type='usb' index='0' model='none'>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='usb'/>
Oct 26 15:52:24 user nova-compute[74646]:     </controller>
Oct 26 15:52:24 user nova-compute[74646]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='pci.0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </controller>
Oct 26 15:52:24 user nova-compute[74646]:     <controller type='ide' index='0'>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='ide'/>
Oct 26 15:52:24 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 15:52:24 user nova-compute[74646]:     </controller>
Oct 26 15:52:24 user nova-compute[74646]:     <interface type='ethernet'>
Oct 26 15:52:24 user nova-compute[74646]:       <mac address='fa:16:3e:e2:d4:d9'/>
Oct 26 15:52:24 user nova-compute[74646]:       <target dev='tapc03623fa-06'/>
Oct 26 15:52:24 user nova-compute[74646]:       <model type='virtio'/>
Oct 26 15:52:24 user nova-compute[74646]:       <mtu size='1442'/>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='net0'/>
Oct 26 15:52:24 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </interface>
Oct 26 15:52:24 user nova-compute[74646]:     <serial type='pty'>
Oct 26 15:52:24 user nova-compute[74646]:       <source path='/dev/pts/5'/>
Oct 26 15:52:24 user nova-compute[74646]:       <log file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/console.log' append='off'/>
Oct 26 15:52:24 user nova-compute[74646]:       <target type='isa-serial' port='0'>
Oct 26 15:52:24 user nova-compute[74646]:         <model name='isa-serial'/>
Oct 26 15:52:24 user nova-compute[74646]:       </target>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='serial0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </serial>
Oct 26 15:52:24 user nova-compute[74646]:     <console type='pty' tty='/dev/pts/5'>
Oct 26 15:52:24 user nova-compute[74646]:       <source path='/dev/pts/5'/>
Oct 26 15:52:24 user nova-compute[74646]:       <log file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/console.log' append='off'/>
Oct 26 15:52:24 user nova-compute[74646]:       <target type='serial' port='0'/>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='serial0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </console>
Oct 26 15:52:24 user nova-compute[74646]:     <input type='mouse' bus='ps2'>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='input0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </input>
Oct 26 15:52:24 user nova-compute[74646]:     <input type='keyboard' bus='ps2'>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='input1'/>
Oct 26 15:52:24 user nova-compute[74646]:     </input>
Oct 26 15:52:24 user nova-compute[74646]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 26 15:52:24 user nova-compute[74646]:       <listen type='address' address='0.0.0.0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </graphics>
Oct 26 15:52:24 user nova-compute[74646]:     <audio id='1' type='none'/>
Oct 26 15:52:24 user nova-compute[74646]:     <video>
Oct 26 15:52:24 user nova-compute[74646]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='video0'/>
Oct 26 15:52:24 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </video>
Oct 26 15:52:24 user nova-compute[74646]:     <memballoon model='virtio'>
Oct 26 15:52:24 user nova-compute[74646]:       <stats period='10'/>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='balloon0'/>
Oct 26 15:52:24 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </memballoon>
Oct 26 15:52:24 user nova-compute[74646]:     <rng model='virtio'>
Oct 26 15:52:24 user nova-compute[74646]:       <backend model='random'>/dev/urandom</backend>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='rng0'/>
Oct 26 15:52:24 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </rng>
Oct 26 15:52:24 user nova-compute[74646]:   </devices>
Oct 26 15:52:24 user nova-compute[74646]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 15:52:24 user nova-compute[74646]:     <label>libvirt-8edad9e5-5649-4ac7-a885-ae2d85cfeafe</label>
Oct 26 15:52:24 user nova-compute[74646]:     <imagelabel>libvirt-8edad9e5-5649-4ac7-a885-ae2d85cfeafe</imagelabel>
Oct 26 15:52:24 user nova-compute[74646]:   </seclabel>
Oct 26 15:52:24 user nova-compute[74646]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 15:52:24 user nova-compute[74646]:     <label>+64055:+108</label>
Oct 26 15:52:24 user nova-compute[74646]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 15:52:24 user nova-compute[74646]:   </seclabel>
Oct 26 15:52:24 user nova-compute[74646]: </domain>
Oct 26 15:52:24 user nova-compute[74646]:  {{(pid=74646) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:82:84:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap80bebc53-31"/></interface> {{(pid=74646) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:82:84:7f"/><model type="virtio"/><mtu size="1442"/><target dev="tap80bebc53-31"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 26 15:52:24 user nova-compute[74646]:   <name>instance-00000006</name>
Oct 26 15:52:24 user nova-compute[74646]:   <uuid>8edad9e5-5649-4ac7-a885-ae2d85cfeafe</uuid>
Oct 26 15:52:24 user nova-compute[74646]:   <metadata>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:52:24 user nova-compute[74646]:   <nova:package version="0.0.0"/>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:name>tempest-device-tagging-server-109261951</nova:name>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:creationTime>2023-10-26 15:52:23</nova:creationTime>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:flavor name="m1.tiny">
Oct 26 15:52:24 user nova-compute[74646]:     <nova:memory>512</nova:memory>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:disk>1</nova:disk>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:swap>0</nova:swap>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:vcpus>1</nova:vcpus>
Oct 26 15:52:24 user nova-compute[74646]:   </nova:flavor>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:owner>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:user uuid="723b9bbed73446b29f877a87c48234fe">tempest-TaggedAttachmentsTest-180887235-project-member</nova:user>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:project uuid="c2d636dad453466192a545f54098b6ef">tempest-TaggedAttachmentsTest-180887235</nova:project>
Oct 26 15:52:24 user nova-compute[74646]:   </nova:owner>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:ports>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:port uuid="c03623fa-065f-47ad-9127-5fdebf97a32d">
Oct 26 15:52:24 user nova-compute[74646]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 15:52:24 user nova-compute[74646]:     </nova:port>
Oct 26 15:52:24 user nova-compute[74646]:   </nova:ports>
Oct 26 15:52:24 user nova-compute[74646]: </nova:instance>
Oct 26 15:52:24 user nova-compute[74646]:   </metadata>
Oct 26 15:52:24 user nova-compute[74646]:   <memory unit='KiB'>524288</memory>
Oct 26 15:52:24 user nova-compute[74646]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 26 15:52:24 user nova-compute[74646]:   <vcpu placement='static'>1</vcpu>
Oct 26 15:52:24 user nova-compute[74646]:   <resource>
Oct 26 15:52:24 user nova-compute[74646]:     <partition>/machine</partition>
Oct 26 15:52:24 user nova-compute[74646]:   </resource>
Oct 26 15:52:24 user nova-compute[74646]:   <sysinfo type='smbios'>
Oct 26 15:52:24 user nova-compute[74646]:     <system>
Oct 26 15:52:24 user nova-compute[74646]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 26 15:52:24 user nova-compute[74646]:       <entry name='product'>OpenStack Nova</entry>
Oct 26 15:52:24 user nova-compute[74646]:       <entry name='version'>0.0.0</entry>
Oct 26 15:52:24 user nova-compute[74646]:       <entry name='serial'>8edad9e5-5649-4ac7-a885-ae2d85cfeafe</entry>
Oct 26 15:52:24 user nova-compute[74646]:       <entry name='uuid'>8edad9e5-5649-4ac7-a885-ae2d85cfeafe</entry>
Oct 26 15:52:24 user nova-compute[74646]:       <entry name='family'>Virtual Machine</entry>
Oct 26 15:52:24 user nova-compute[74646]:     </system>
Oct 26 15:52:24 user nova-compute[74646]:   </sysinfo>
Oct 26 15:52:24 user nova-compute[74646]:   <os>
Oct 26 15:52:24 user nova-compute[74646]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 26 15:52:24 user nova-compute[74646]:     <boot dev='hd'/>
Oct 26 15:52:24 user nova-compute[74646]:     <smbios mode='sysinfo'/>
Oct 26 15:52:24 user nova-compute[74646]:   </os>
Oct 26 15:52:24 user nova-compute[74646]:   <features>
Oct 26 15:52:24 user nova-compute[74646]:     <acpi/>
Oct 26 15:52:24 user nova-compute[74646]:     <apic/>
Oct 26 15:52:24 user nova-compute[74646]:     <vmcoreinfo state='on'/>
Oct 26 15:52:24 user nova-compute[74646]:   </features>
Oct 26 15:52:24 user nova-compute[74646]:   <cpu mode='custom' match='exact' check='full'>
Oct 26 15:52:24 user nova-compute[74646]:     <model fallback='forbid'>Nehalem</model>
Oct 26 15:52:24 user nova-compute[74646]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 26 15:52:24 user nova-compute[74646]:     <feature policy='require' name='vme'/>
Oct 26 15:52:24 user nova-compute[74646]:     <feature policy='require' name='x2apic'/>
Oct 26 15:52:24 user nova-compute[74646]:     <feature policy='require' name='hypervisor'/>
Oct 26 15:52:24 user nova-compute[74646]:   </cpu>
Oct 26 15:52:24 user nova-compute[74646]:   <clock offset='utc'>
Oct 26 15:52:24 user nova-compute[74646]:     <timer name='pit' tickpolicy='delay'/>
Oct 26 15:52:24 user nova-compute[74646]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 26 15:52:24 user nova-compute[74646]:     <timer name='hpet' present='no'/>
Oct 26 15:52:24 user nova-compute[74646]:   </clock>
Oct 26 15:52:24 user nova-compute[74646]:   <on_poweroff>destroy</on_poweroff>
Oct 26 15:52:24 user nova-compute[74646]:   <on_reboot>restart</on_reboot>
Oct 26 15:52:24 user nova-compute[74646]:   <on_crash>destroy</on_crash>
Oct 26 15:52:24 user nova-compute[74646]:   <devices>
Oct 26 15:52:24 user nova-compute[74646]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 26 15:52:24 user nova-compute[74646]:     <disk type='file' device='disk'>
Oct 26 15:52:24 user nova-compute[74646]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 26 15:52:24 user nova-compute[74646]:       <source file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk' index='2'/>
Oct 26 15:52:24 user nova-compute[74646]:       <backingStore type='file' index='3'>
Oct 26 15:52:24 user nova-compute[74646]:         <format type='raw'/>
Oct 26 15:52:24 user nova-compute[74646]:         <source file='/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7'/>
Oct 26 15:52:24 user nova-compute[74646]:         <backingStore/>
Oct 26 15:52:24 user nova-compute[74646]:       </backingStore>
Oct 26 15:52:24 user nova-compute[74646]:       <target dev='vda' bus='virtio'/>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='virtio-disk0'/>
Oct 26 15:52:24 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </disk>
Oct 26 15:52:24 user nova-compute[74646]:     <disk type='file' device='cdrom'>
Oct 26 15:52:24 user nova-compute[74646]:       <driver name='qemu' type='raw' cache='none'/>
Oct 26 15:52:24 user nova-compute[74646]:       <source file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/disk.config' index='1'/>
Oct 26 15:52:24 user nova-compute[74646]:       <backingStore/>
Oct 26 15:52:24 user nova-compute[74646]:       <target dev='hda' bus='ide'/>
Oct 26 15:52:24 user nova-compute[74646]:       <readonly/>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='ide0-0-0'/>
Oct 26 15:52:24 user nova-compute[74646]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </disk>
Oct 26 15:52:24 user nova-compute[74646]:     <controller type='usb' index='0' model='none'>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='usb'/>
Oct 26 15:52:24 user nova-compute[74646]:     </controller>
Oct 26 15:52:24 user nova-compute[74646]:     <controller type='pci' index='0' model='pci-root'>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='pci.0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </controller>
Oct 26 15:52:24 user nova-compute[74646]:     <controller type='ide' index='0'>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='ide'/>
Oct 26 15:52:24 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 26 15:52:24 user nova-compute[74646]:     </controller>
Oct 26 15:52:24 user nova-compute[74646]:     <interface type='ethernet'>
Oct 26 15:52:24 user nova-compute[74646]:       <mac address='fa:16:3e:e2:d4:d9'/>
Oct 26 15:52:24 user nova-compute[74646]:       <target dev='tapc03623fa-06'/>
Oct 26 15:52:24 user nova-compute[74646]:       <model type='virtio'/>
Oct 26 15:52:24 user nova-compute[74646]:       <mtu size='1442'/>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='net0'/>
Oct 26 15:52:24 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </interface>
Oct 26 15:52:24 user nova-compute[74646]:     <serial type='pty'>
Oct 26 15:52:24 user nova-compute[74646]:       <source path='/dev/pts/5'/>
Oct 26 15:52:24 user nova-compute[74646]:       <log file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/console.log' append='off'/>
Oct 26 15:52:24 user nova-compute[74646]:       <target type='isa-serial' port='0'>
Oct 26 15:52:24 user nova-compute[74646]:         <model name='isa-serial'/>
Oct 26 15:52:24 user nova-compute[74646]:       </target>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='serial0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </serial>
Oct 26 15:52:24 user nova-compute[74646]:     <console type='pty' tty='/dev/pts/5'>
Oct 26 15:52:24 user nova-compute[74646]:       <source path='/dev/pts/5'/>
Oct 26 15:52:24 user nova-compute[74646]:       <log file='/opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe/console.log' append='off'/>
Oct 26 15:52:24 user nova-compute[74646]:       <target type='serial' port='0'/>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='serial0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </console>
Oct 26 15:52:24 user nova-compute[74646]:     <input type='mouse' bus='ps2'>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='input0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </input>
Oct 26 15:52:24 user nova-compute[74646]:     <input type='keyboard' bus='ps2'>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='input1'/>
Oct 26 15:52:24 user nova-compute[74646]:     </input>
Oct 26 15:52:24 user nova-compute[74646]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 26 15:52:24 user nova-compute[74646]:       <listen type='address' address='0.0.0.0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </graphics>
Oct 26 15:52:24 user nova-compute[74646]:     <audio id='1' type='none'/>
Oct 26 15:52:24 user nova-compute[74646]:     <video>
Oct 26 15:52:24 user nova-compute[74646]:       <model type='virtio' heads='1' primary='yes'/>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='video0'/>
Oct 26 15:52:24 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </video>
Oct 26 15:52:24 user nova-compute[74646]:     <memballoon model='virtio'>
Oct 26 15:52:24 user nova-compute[74646]:       <stats period='10'/>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='balloon0'/>
Oct 26 15:52:24 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </memballoon>
Oct 26 15:52:24 user nova-compute[74646]:     <rng model='virtio'>
Oct 26 15:52:24 user nova-compute[74646]:       <backend model='random'>/dev/urandom</backend>
Oct 26 15:52:24 user nova-compute[74646]:       <alias name='rng0'/>
Oct 26 15:52:24 user nova-compute[74646]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 26 15:52:24 user nova-compute[74646]:     </rng>
Oct 26 15:52:24 user nova-compute[74646]:   </devices>
Oct 26 15:52:24 user nova-compute[74646]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 26 15:52:24 user nova-compute[74646]:     <label>libvirt-8edad9e5-5649-4ac7-a885-ae2d85cfeafe</label>
Oct 26 15:52:24 user nova-compute[74646]:     <imagelabel>libvirt-8edad9e5-5649-4ac7-a885-ae2d85cfeafe</imagelabel>
Oct 26 15:52:24 user nova-compute[74646]:   </seclabel>
Oct 26 15:52:24 user nova-compute[74646]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 26 15:52:24 user nova-compute[74646]:     <label>+64055:+108</label>
Oct 26 15:52:24 user nova-compute[74646]:     <imagelabel>+64055:+108</imagelabel>
Oct 26 15:52:24 user nova-compute[74646]:   </seclabel>
Oct 26 15:52:24 user nova-compute[74646]: </domain>
Oct 26 15:52:24 user nova-compute[74646]:  {{(pid=74646) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 26 15:52:24 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Detaching interface fa:16:3e:82:84:7f failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap80bebc53-31' not found.
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-109261951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-109261951',id=6,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORFY2BSLaMhq/E5p+UHLBw9zanVj3hPYzpAhpE2tuRkW9nT+9656pE9yOGjFfMafxl/9w7KQhKQ7j+X841AaJHigdfvo2GKz6ua9+kNxAcYmgo0FYMnOu5s42XAwkFHvw==',key_name='tempest-keypair-1091666697',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2d636dad453466192a545f54098b6ef',ramdisk_id='',reservation_id='r-2mi45cco',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-180887235',owner_user_name='tempest-TaggedAttachmentsTest-180887235-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:49:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='723b9bbed73446b29f877a87c48234fe',uuid=8edad9e5-5649-4ac7-a885-ae2d85cfeafe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "address": "fa:16:3e:82:84:7f", "network": {"id": "8f104fed-08e3-4de9-b66a-7fe8c239c70f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2031322880", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bebc53-31", "ovs_interfaceid": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.network.os_vif_util [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] Converting VIF {"id": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "address": "fa:16:3e:82:84:7f", "network": {"id": "8f104fed-08e3-4de9-b66a-7fe8c239c70f", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-2031322880", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.215", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80bebc53-31", "ovs_interfaceid": "80bebc53-31f0-4b1e-8abb-50bf65fdbc16", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.network.os_vif_util [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7f,bridge_name='br-int',has_traffic_filtering=True,id=80bebc53-31f0-4b1e-8abb-50bf65fdbc16,network=Network(8f104fed-08e3-4de9-b66a-7fe8c239c70f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bebc53-31') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG os_vif [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7f,bridge_name='br-int',has_traffic_filtering=True,id=80bebc53-31f0-4b1e-8abb-50bf65fdbc16,network=Network(8f104fed-08e3-4de9-b66a-7fe8c239c70f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bebc53-31') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80bebc53-31, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:52:24 user nova-compute[74646]: INFO os_vif [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:84:7f,bridge_name='br-int',has_traffic_filtering=True,id=80bebc53-31f0-4b1e-8abb-50bf65fdbc16,network=Network(8f104fed-08e3-4de9-b66a-7fe8c239c70f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80bebc53-31')
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [req-17844d3f-b2fa-4153-8fdf-1f76939bec16 req-8813dc39-0956-49c5-97d7-cf8ed413d23e service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:52:24 user nova-compute[74646]:   <nova:package version="0.0.0"/>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:name>tempest-device-tagging-server-109261951</nova:name>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:creationTime>2023-10-26 15:52:24</nova:creationTime>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:flavor name="m1.tiny">
Oct 26 15:52:24 user nova-compute[74646]:     <nova:memory>512</nova:memory>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:disk>1</nova:disk>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:swap>0</nova:swap>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:vcpus>1</nova:vcpus>
Oct 26 15:52:24 user nova-compute[74646]:   </nova:flavor>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:owner>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:user uuid="723b9bbed73446b29f877a87c48234fe">tempest-TaggedAttachmentsTest-180887235-project-member</nova:user>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:project uuid="c2d636dad453466192a545f54098b6ef">tempest-TaggedAttachmentsTest-180887235</nova:project>
Oct 26 15:52:24 user nova-compute[74646]:   </nova:owner>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:52:24 user nova-compute[74646]:   <nova:ports>
Oct 26 15:52:24 user nova-compute[74646]:     <nova:port uuid="c03623fa-065f-47ad-9127-5fdebf97a32d">
Oct 26 15:52:24 user nova-compute[74646]:       <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 15:52:24 user nova-compute[74646]:     </nova:port>
Oct 26 15:52:24 user nova-compute[74646]:   </nova:ports>
Oct 26 15:52:24 user nova-compute[74646]: </nova:instance>
Oct 26 15:52:24 user nova-compute[74646]:  {{(pid=74646) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Updating instance_info_cache with network_info: [{"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Releasing lock "refresh_cache-8edad9e5-5649-4ac7-a885-ae2d85cfeafe" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:52:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6fbde1aa-0733-4a68-ba91-41918ee978ee tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "interface-8edad9e5-5649-4ac7-a885-ae2d85cfeafe-80bebc53-31f0-4b1e-8abb-50bf65fdbc16" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.417s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Acquiring lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG os_brick.utils [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4ca710-0cb6-45bd-97e8-b3ea3f0901fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5ae179-92e7-4315-b9c8-f9eb92b48c40]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1982323d-cca6-4282-a39b-9aae2f61a8a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd52927b-f9bf-4192-ae82-2735475e3a42]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:25 user nova-compute[74646]: INFO nova.compute.manager [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Terminating instance
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:52:25 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca734784-5958-4376-92b5-4f0e6f2a480b]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG nova.compute.manager [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG os_brick.utils [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:25 user nova-compute[74646]: INFO nova.compute.manager [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Swapping volume 6f434a4a-7fc0-4202-a626-c63a0c54769a for b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e
Oct 26 15:52:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-5b4f7aa8-7367-4fb4-b4d9-9a4050bcccaf req-0a15b651-6e83-4be0-860c-0ed15feb9872 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Received event network-vif-unplugged-c3fe6baa-9489-4801-a5cc-06b98d0f98f2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5b4f7aa8-7367-4fb4-b4d9-9a4050bcccaf req-0a15b651-6e83-4be0-860c-0ed15feb9872 service nova] Acquiring lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5b4f7aa8-7367-4fb4-b4d9-9a4050bcccaf req-0a15b651-6e83-4be0-860c-0ed15feb9872 service nova] Lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5b4f7aa8-7367-4fb4-b4d9-9a4050bcccaf req-0a15b651-6e83-4be0-860c-0ed15feb9872 service nova] Lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-5b4f7aa8-7367-4fb4-b4d9-9a4050bcccaf req-0a15b651-6e83-4be0-860c-0ed15feb9872 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] No waiting events found dispatching network-vif-unplugged-c3fe6baa-9489-4801-a5cc-06b98d0f98f2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-5b4f7aa8-7367-4fb4-b4d9-9a4050bcccaf req-0a15b651-6e83-4be0-860c-0ed15feb9872 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Received event network-vif-unplugged-c3fe6baa-9489-4801-a5cc-06b98d0f98f2 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:52:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:26 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Instance destroyed successfully.
Oct 26 15:52:26 user nova-compute[74646]: DEBUG nova.objects.instance [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lazy-loading 'resources' on Instance uuid e8268040-8dbe-4320-94e9-f6cdaf4eb157 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-555869499',display_name='tempest-VolumesActionsTest-instance-555869499',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-555869499',id=9,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9073433dc0b34618b5c52f010e49400e',ramdisk_id='',reservation_id='r-zeyd0qb5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1225783245',owner_user_name='tempest-VolumesActionsTest-1225783245-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:50:36Z,user_data=None,user_id='41bb4004c8444824bb91ff40a872c7cd',uuid=e8268040-8dbe-4320-94e9-f6cdaf4eb157,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "address": "fa:16:3e:b5:0c:58", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fe6baa-94", "ovs_interfaceid": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Converting VIF {"id": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "address": "fa:16:3e:b5:0c:58", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fe6baa-94", "ovs_interfaceid": "c3fe6baa-9489-4801-a5cc-06b98d0f98f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0c:58,bridge_name='br-int',has_traffic_filtering=True,id=c3fe6baa-9489-4801-a5cc-06b98d0f98f2,network=Network(fdc4cebd-c95f-4365-86a0-09b4b4a847b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fe6baa-94') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG os_vif [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0c:58,bridge_name='br-int',has_traffic_filtering=True,id=c3fe6baa-9489-4801-a5cc-06b98d0f98f2,network=Network(fdc4cebd-c95f-4365-86a0-09b4b4a847b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fe6baa-94') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3fe6baa-94, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3db00a37-f297-433c-a264-7521c008e939) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:26 user nova-compute[74646]: INFO os_vif [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:0c:58,bridge_name='br-int',has_traffic_filtering=True,id=c3fe6baa-9489-4801-a5cc-06b98d0f98f2,network=Network(fdc4cebd-c95f-4365-86a0-09b4b4a847b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fe6baa-94')
Oct 26 15:52:26 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Deleting instance files /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157_del
Oct 26 15:52:26 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Deletion of /opt/stack/data/nova/instances/e8268040-8dbe-4320-94e9-f6cdaf4eb157_del complete
Oct 26 15:52:26 user nova-compute[74646]: INFO nova.compute.manager [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 26 15:52:26 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:26 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Took 0.44 seconds to deallocate network for instance.
Oct 26 15:52:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-8f19998a-145e-46f1-b934-74464176fbd0 req-5cd1a4d3-3648-4e45-a2ac-f8ca0db48e62 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Received event network-vif-deleted-c3fe6baa-9489-4801-a5cc-06b98d0f98f2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:52:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:26 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Deleted allocations for instance e8268040-8dbe-4320-94e9-f6cdaf4eb157
Oct 26 15:52:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8477b73c-b22f-42d1-afba-246f6f3a8562 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.607s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-a98781be-0f1e-4608-a248-5d079cfebf56 req-aa8375c5-9408-474b-8416-5047071bff81 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Received event network-vif-plugged-c3fe6baa-9489-4801-a5cc-06b98d0f98f2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a98781be-0f1e-4608-a248-5d079cfebf56 req-aa8375c5-9408-474b-8416-5047071bff81 service nova] Acquiring lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a98781be-0f1e-4608-a248-5d079cfebf56 req-aa8375c5-9408-474b-8416-5047071bff81 service nova] Lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a98781be-0f1e-4608-a248-5d079cfebf56 req-aa8375c5-9408-474b-8416-5047071bff81 service nova] Lock "e8268040-8dbe-4320-94e9-f6cdaf4eb157-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-a98781be-0f1e-4608-a248-5d079cfebf56 req-aa8375c5-9408-474b-8416-5047071bff81 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] No waiting events found dispatching network-vif-plugged-c3fe6baa-9489-4801-a5cc-06b98d0f98f2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:52:27 user nova-compute[74646]: WARNING nova.compute.manager [req-a98781be-0f1e-4608-a248-5d079cfebf56 req-aa8375c5-9408-474b-8416-5047071bff81 service nova] [instance: e8268040-8dbe-4320-94e9-f6cdaf4eb157] Received unexpected event network-vif-plugged-c3fe6baa-9489-4801-a5cc-06b98d0f98f2 for instance with vm_state deleted and task_state None.
Oct 26 15:52:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG nova.compute.manager [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ulwqvmXo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b8a97889-399d-46ec-ac9a-8d2db324ce69', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 'serial': 'b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HtRArpuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '6f434a4a-7fc0-4202-a626-c63a0c54769a'}, 'status': 'reserved', 'instance': 'b8a97889-399d-46ec-ac9a-8d2db324ce69', 'attached_at': '', 'detached_at': '', 'volume_id': '6f434a4a-7fc0-4202-a626-c63a0c54769a', 'serial'} {{(pid=74646) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ulwqvmXo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:52:44 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:52:44 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:52:44 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[91664585-3ee1-4ad5-8a2d-0b99bf81f37e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:52:44 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[603f2103-ddb9-49ff-9463-1d81bf820028]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e] added
Oct 26 15:52:44 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a768dee-a8bb-4545-86b5-7f82f61a466d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab7fe35-59ab-48b8-8a16-4dc528e91786]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ulwqvmXo {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ulwqvmXo" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a130b6ff-f8ed-4890-bb45-4edf66bccc27]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ulwqvmXo'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46bc82d-9004-4177-991b-6262ea18bbcc]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbebb48-5f69-4dbf-a924-bb87e6cfcae2]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)
Oct 26 15:52:44 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)
Oct 26 15:52:44 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede013c5-fa03-4f2b-8339-d3fe41e1f2ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260]
Oct 26 15:52:44 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260] successful.
Oct 26 15:52:44 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fd47bd-37c7-4b69-aadd-25044f9404aa]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee98012c-140c-4ae8-921a-86c0c0b8b553]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)
Oct 26 15:52:44 user nova-compute[74646]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:52:44 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)
Oct 26 15:52:44 user nova-compute[74646]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:52:44 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] HCTL ('34', '-', '-', 0) found on session 8 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[18155461-86b8-4d68-a91c-f8ccd9098852]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Searching for a device in session 8 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:52:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ulwqvmXo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:52:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:52:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23736613136396662', 'path': '/dev/sdc'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:52:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23736613136396662', 'path': '/dev/sdc'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:52:45 user nova-compute[74646]: DEBUG nova.objects.instance [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lazy-loading 'flavor' on Instance uuid b8a97889-399d-46ec-ac9a-8d2db324ce69 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:52:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:52:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 115343360 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 278921216 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 457179136 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 636485632 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 808452096 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 970981376 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HtRArpuO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': '6f434a4a-7fc0-4202-a626-c63a0c54769a'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:52:49 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4fd4535-d7c9-4b38-8bf3-e353d7a2a45d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:52:49 user nova-compute[74646]: No targets found.
Oct 26 15:52:49 user nova-compute[74646]: iSNS:
Oct 26 15:52:49 user nova-compute[74646]: No targets found.
Oct 26 15:52:49 user nova-compute[74646]: STATIC:
Oct 26 15:52:49 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a
Oct 26 15:52:49 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:52:49 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:52:49 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e
Oct 26 15:52:49 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:52:49 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:52:49 user nova-compute[74646]: FIRMWARE:
Oct 26 15:52:49 user nova-compute[74646]: No targets found.
Oct 26 15:52:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:52:49 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:52:49 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e65a7c-3b01-43cb-b629-e3e19a3414ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[773da660-4d2d-4153-9bd9-91e2ab1dc19c]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)
Oct 26 15:52:49 user nova-compute[74646]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:52:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a (non-flash)
Oct 26 15:52:49 user nova-compute[74646]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:52:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e01ce3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a'): ({'sdb'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Removing single pathed devices sdb {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[68db06ba-7aea-47c3-a753-148024a77710]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[629430a2-0d26-4057-9e9e-40ed165dae8a]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Flushing IO for device /dev/sdb {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[358f6f39-1e69-4566-ab4a-e0a9b38c7d71]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f16faf2-7f70-4afc-9ca4-043a39f24db8]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Checking to see if SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdeaea0a-a39c-4b01-98e9-611fe27c361b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[957aefd2-71d4-4640-ad50-883b0b552e2b]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a, portal: 172.16.0.220,3260]
Oct 26 15:52:49 user nova-compute[74646]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a, portal: 172.16.0.220,3260] successful.
Oct 26 15:52:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f434a4a-7fc0-4202-a626-c63a0c54769a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ad4b3e-d15f-499a-8391-da1ca597c2f7]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] <== disconnect_volume: return (315ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:52:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:52:50 user nova-compute[74646]: DEBUG nova.compute.manager [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ulwqvmXo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'b8a97889-399d-46ec-ac9a-8d2db324ce69', 'attached_at': '', 'detached_at': '', 'volume_id': 'b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 'serial'} {{(pid=74646) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 26 15:52:50 user nova-compute[74646]: DEBUG nova.compute.manager [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] swap_volume: removing Cinder connection for volume 6f434a4a-7fc0-4202-a626-c63a0c54769a {{(pid=74646) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 26 15:52:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:56 user nova-compute[74646]: INFO nova.virt.block_device [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Booting with volume 8cb56e7e-52ac-42eb-ba50-23f42b33acb8 at /dev/vdb
Oct 26 15:52:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG os_brick.utils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8157623e-58bc-4243-9141-caad42478d89]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c625867-b6e7-4d71-ab55-85669c2fe6c3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0dc5be-7ea8-4d96-8f3b-238caf806f8c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7075ada-4294-41f2-a0e5-114c1128105c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:52:56 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[122e9bd7-4e14-4a42-a4c6-dad6ca613ff2]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG os_brick.utils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updating existing volume attachment record: be02b93c-c532-479f-a7bc-ed252b93bafb {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:56 user nova-compute[74646]: INFO nova.compute.manager [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Terminating instance
Oct 26 15:52:56 user nova-compute[74646]: DEBUG nova.compute.manager [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-1588e651-3be6-40cf-a0b4-002ac4f6491b req-d5ddad92-17ff-431e-9bea-2af98129ca4a service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received event network-vif-unplugged-c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1588e651-3be6-40cf-a0b4-002ac4f6491b req-d5ddad92-17ff-431e-9bea-2af98129ca4a service nova] Acquiring lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1588e651-3be6-40cf-a0b4-002ac4f6491b req-d5ddad92-17ff-431e-9bea-2af98129ca4a service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1588e651-3be6-40cf-a0b4-002ac4f6491b req-d5ddad92-17ff-431e-9bea-2af98129ca4a service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-1588e651-3be6-40cf-a0b4-002ac4f6491b req-d5ddad92-17ff-431e-9bea-2af98129ca4a service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] No waiting events found dispatching network-vif-unplugged-c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:52:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-1588e651-3be6-40cf-a0b4-002ac4f6491b req-d5ddad92-17ff-431e-9bea-2af98129ca4a service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received event network-vif-unplugged-c03623fa-065f-47ad-9127-5fdebf97a32d for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:52:57 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Instance destroyed successfully.
Oct 26 15:52:57 user nova-compute[74646]: DEBUG nova.objects.instance [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lazy-loading 'resources' on Instance uuid 8edad9e5-5649-4ac7-a885-ae2d85cfeafe {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:48:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-109261951',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-109261951',id=6,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORFY2BSLaMhq/E5p+UHLBw9zanVj3hPYzpAhpE2tuRkW9nT+9656pE9yOGjFfMafxl/9w7KQhKQ7j+X841AaJHigdfvo2GKz6ua9+kNxAcYmgo0FYMnOu5s42XAwkFHvw==',key_name='tempest-keypair-1091666697',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:49:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c2d636dad453466192a545f54098b6ef',ramdisk_id='',reservation_id='r-2mi45cco',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-180887235',owner_user_name='tempest-TaggedAttachmentsTest-180887235-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:49:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='723b9bbed73446b29f877a87c48234fe',uuid=8edad9e5-5649-4ac7-a885-ae2d85cfeafe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Converting VIF {"id": "c03623fa-065f-47ad-9127-5fdebf97a32d", "address": "fa:16:3e:e2:d4:d9", "network": {"id": "1886d1dd-4e6f-4725-b822-e4edeeeafe53", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-171089062-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c2d636dad453466192a545f54098b6ef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc03623fa-06", "ovs_interfaceid": "c03623fa-065f-47ad-9127-5fdebf97a32d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e2:d4:d9,bridge_name='br-int',has_traffic_filtering=True,id=c03623fa-065f-47ad-9127-5fdebf97a32d,network=Network(1886d1dd-4e6f-4725-b822-e4edeeeafe53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc03623fa-06') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG os_vif [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:d4:d9,bridge_name='br-int',has_traffic_filtering=True,id=c03623fa-065f-47ad-9127-5fdebf97a32d,network=Network(1886d1dd-4e6f-4725-b822-e4edeeeafe53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc03623fa-06') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc03623fa-06, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95fd8f61-a9ba-403f-87af-2a74e796e63a) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:57 user nova-compute[74646]: INFO os_vif [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e2:d4:d9,bridge_name='br-int',has_traffic_filtering=True,id=c03623fa-065f-47ad-9127-5fdebf97a32d,network=Network(1886d1dd-4e6f-4725-b822-e4edeeeafe53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc03623fa-06')
Oct 26 15:52:57 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Deleting instance files /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe_del
Oct 26 15:52:57 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Deletion of /opt/stack/data/nova/instances/8edad9e5-5649-4ac7-a885-ae2d85cfeafe_del complete
Oct 26 15:52:57 user nova-compute[74646]: INFO nova.compute.manager [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 26 15:52:57 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 15:52:57 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:57 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Took 0.72 seconds to deallocate network for instance.
Oct 26 15:52:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-daa32d08-6cbb-4d17-b0b3-efdf97d3368e req-9c3bc01c-fd27-471e-a03e-b10faa22bfb3 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received event network-vif-deleted-c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:58 user nova-compute[74646]: INFO nova.compute.manager [req-daa32d08-6cbb-4d17-b0b3-efdf97d3368e req-9c3bc01c-fd27-471e-a03e-b10faa22bfb3 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Neutron deleted interface c03623fa-065f-47ad-9127-5fdebf97a32d; detaching it from the instance and deleting it from the info cache
Oct 26 15:52:58 user nova-compute[74646]: DEBUG nova.network.neutron [req-daa32d08-6cbb-4d17-b0b3-efdf97d3368e req-9c3bc01c-fd27-471e-a03e-b10faa22bfb3 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:52:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-daa32d08-6cbb-4d17-b0b3-efdf97d3368e req-9c3bc01c-fd27-471e-a03e-b10faa22bfb3 service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Detach interface failed, port_id=c03623fa-065f-47ad-9127-5fdebf97a32d, reason: Instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe could not be found. {{(pid=74646) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 15:52:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:58 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:52:58 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:52:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:58 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Deleted allocations for instance 8edad9e5-5649-4ac7-a885-ae2d85cfeafe
Oct 26 15:52:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-96cb021d-f8f5-4a3f-a27d-8fa312ce724e tempest-TaggedAttachmentsTest-180887235 tempest-TaggedAttachmentsTest-180887235-project-member] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.180s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:52:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-cd135ef3-6979-4d60-b96b-d67ba99d4bd5 req-90b977b2-bbfd-456c-97b9-388eeeb88f3d service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received event network-vif-plugged-c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:52:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cd135ef3-6979-4d60-b96b-d67ba99d4bd5 req-90b977b2-bbfd-456c-97b9-388eeeb88f3d service nova] Acquiring lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:52:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cd135ef3-6979-4d60-b96b-d67ba99d4bd5 req-90b977b2-bbfd-456c-97b9-388eeeb88f3d service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:52:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cd135ef3-6979-4d60-b96b-d67ba99d4bd5 req-90b977b2-bbfd-456c-97b9-388eeeb88f3d service nova] Lock "8edad9e5-5649-4ac7-a885-ae2d85cfeafe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:52:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-cd135ef3-6979-4d60-b96b-d67ba99d4bd5 req-90b977b2-bbfd-456c-97b9-388eeeb88f3d service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] No waiting events found dispatching network-vif-plugged-c03623fa-065f-47ad-9127-5fdebf97a32d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:52:58 user nova-compute[74646]: WARNING nova.compute.manager [req-cd135ef3-6979-4d60-b96b-d67ba99d4bd5 req-90b977b2-bbfd-456c-97b9-388eeeb88f3d service nova] [instance: 8edad9e5-5649-4ac7-a885-ae2d85cfeafe] Received unexpected event network-vif-plugged-c03623fa-065f-47ad-9127-5fdebf97a32d for instance with vm_state deleted and task_state None.
Oct 26 15:53:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:05 user nova-compute[74646]: DEBUG nova.compute.manager [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] swap_volume: Updating volume 6f434a4a-7fc0-4202-a626-c63a0c54769a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "ulwqvmXo", "auth_password": "9S1VKFzQYk2Idj", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e"}, "status": "reserved", "instance": "b8a97889-399d-46ec-ac9a-8d2db324ce69", "attached_at": "", "detached_at": "", "volume_id": "b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e", "serial": "b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 'no_device': None, 'attachment_id': 'e0f7d760-fb42-4fca-ae6f-f8f3d4822532'} {{(pid=74646) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 26 15:53:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4218af4e-fe00-4ce6-b0ca-c67231b40213 tempest-TestVolumeSwap-1888189888 tempest-TestVolumeSwap-1888189888-project-admin] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 40.520s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Acquiring lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Acquiring lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:06 user nova-compute[74646]: INFO nova.compute.manager [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Terminating instance
Oct 26 15:53:06 user nova-compute[74646]: DEBUG nova.compute.manager [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-24e90c54-6d01-4ab1-adb2-1d1b3380fdeb req-9c6ac9ac-bde2-4e95-9112-c74d1cb7ee88 service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Received event network-vif-unplugged-c9175401-a233-4208-989d-72f952608659 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-24e90c54-6d01-4ab1-adb2-1d1b3380fdeb req-9c6ac9ac-bde2-4e95-9112-c74d1cb7ee88 service nova] Acquiring lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-24e90c54-6d01-4ab1-adb2-1d1b3380fdeb req-9c6ac9ac-bde2-4e95-9112-c74d1cb7ee88 service nova] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-24e90c54-6d01-4ab1-adb2-1d1b3380fdeb req-9c6ac9ac-bde2-4e95-9112-c74d1cb7ee88 service nova] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-24e90c54-6d01-4ab1-adb2-1d1b3380fdeb req-9c6ac9ac-bde2-4e95-9112-c74d1cb7ee88 service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] No waiting events found dispatching network-vif-unplugged-c9175401-a233-4208-989d-72f952608659 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:53:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-24e90c54-6d01-4ab1-adb2-1d1b3380fdeb req-9c6ac9ac-bde2-4e95-9112-c74d1cb7ee88 service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Received event network-vif-unplugged-c9175401-a233-4208-989d-72f952608659 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:07 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Instance destroyed successfully.
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.objects.instance [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lazy-loading 'resources' on Instance uuid be9a6bab-6958-43bb-9ed8-a531e05ed98d {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:53:07 user nova-compute[74646]: INFO nova.compute.manager [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Detaching volume b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:48:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-472888418',display_name='tempest-VolumesAssistedSnapshotsTest-server-472888418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-472888418',id=5,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBFpZc6Ehu3IYF8RQAWPuhRN5BWJgnEFAOhIeB8bMiuLpOWH1GF/ayvCUM/yuZLad7tgIUQy/M+13dW+XhlUeQEr+bsfguR1zykU+yY6ju8JBfk6PfFi3Po3V5+BGHkXhQ==',key_name='tempest-keypair-1603528482',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:48:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9be77f8e6c0f4a21beabacb7a88f3d02',ramdisk_id='',reservation_id='r-8txe0y07',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-2127871605',owner_user_name='tempest-VolumesAssistedSnapshotsTest-2127871605-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:48:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0ae7d2eb76845c8af23a8c143035e87',uuid=be9a6bab-6958-43bb-9ed8-a531e05ed98d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9175401-a233-4208-989d-72f952608659", "address": "fa:16:3e:4e:a7:bf", "network": {"id": "f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702566873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9be77f8e6c0f4a21beabacb7a88f3d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9175401-a2", "ovs_interfaceid": "c9175401-a233-4208-989d-72f952608659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Converting VIF {"id": "c9175401-a233-4208-989d-72f952608659", "address": "fa:16:3e:4e:a7:bf", "network": {"id": "f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-702566873-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9be77f8e6c0f4a21beabacb7a88f3d02", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9175401-a2", "ovs_interfaceid": "c9175401-a233-4208-989d-72f952608659", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:a7:bf,bridge_name='br-int',has_traffic_filtering=True,id=c9175401-a233-4208-989d-72f952608659,network=Network(f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9175401-a2') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG os_vif [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:a7:bf,bridge_name='br-int',has_traffic_filtering=True,id=c9175401-a233-4208-989d-72f952608659,network=Network(f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9175401-a2') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9175401-a2, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cbe6349a-8a17-4234-aa59-5f225e4028e7) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:53:07 user nova-compute[74646]: INFO os_vif [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:a7:bf,bridge_name='br-int',has_traffic_filtering=True,id=c9175401-a233-4208-989d-72f952608659,network=Network(f23b72f2-f7a4-4ea6-a8ea-af4b0de495e4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9175401-a2')
Oct 26 15:53:07 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Deleting instance files /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d_del
Oct 26 15:53:07 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Deletion of /opt/stack/data/nova/instances/be9a6bab-6958-43bb-9ed8-a531e05ed98d_del complete
Oct 26 15:53:07 user nova-compute[74646]: INFO nova.compute.manager [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 26 15:53:07 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 15:53:07 user nova-compute[74646]: INFO nova.virt.block_device [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Attempting to driver detach volume b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e from mountpoint /dev/vdb
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Attempting to detach device vdb from instance b8a97889-399d-46ec-ac9a-8d2db324ce69 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 15:53:07 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:53:07 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 15:53:07 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:53:07 user nova-compute[74646]:   <serial>b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e</serial>
Oct 26 15:53:07 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 15:53:07 user nova-compute[74646]: </disk>
Oct 26 15:53:07 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:53:07 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Successfully detached device vdb from instance b8a97889-399d-46ec-ac9a-8d2db324ce69 from the persistent domain config.
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b8a97889-399d-46ec-ac9a-8d2db324ce69 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 15:53:07 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:53:07 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 15:53:07 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:53:07 user nova-compute[74646]:   <serial>b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e</serial>
Oct 26 15:53:07 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 15:53:07 user nova-compute[74646]: </disk>
Oct 26 15:53:07 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b8a97889-399d-46ec-ac9a-8d2db324ce69 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:53:07 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Took 0.64 seconds to deallocate network for instance.
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.compute.manager [req-2690718e-e505-4361-95df-492da2ae8e49 req-2934bf88-cdc9-4dce-8c51-ddfa6a0e3eaa service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Received event network-vif-deleted-c9175401-a233-4208-989d-72f952608659 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:53:07 user nova-compute[74646]: INFO nova.compute.manager [req-2690718e-e505-4361-95df-492da2ae8e49 req-2934bf88-cdc9-4dce-8c51-ddfa6a0e3eaa service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Neutron deleted interface c9175401-a233-4208-989d-72f952608659; detaching it from the instance and deleting it from the info cache
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.network.neutron [req-2690718e-e505-4361-95df-492da2ae8e49 req-2934bf88-cdc9-4dce-8c51-ddfa6a0e3eaa service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG nova.compute.manager [req-2690718e-e505-4361-95df-492da2ae8e49 req-2934bf88-cdc9-4dce-8c51-ddfa6a0e3eaa service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Detach interface failed, port_id=c9175401-a233-4208-989d-72f952608659, reason: Instance be9a6bab-6958-43bb-9ed8-a531e05ed98d could not be found. {{(pid=74646) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:08 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:53:08 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:53:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:08 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Deleted allocations for instance be9a6bab-6958-43bb-9ed8-a531e05ed98d
Oct 26 15:53:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5527c115-02ea-426d-bbc7-4c35885e79cf tempest-VolumesAssistedSnapshotsTest-2127871605 tempest-VolumesAssistedSnapshotsTest-2127871605-project-member] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.927s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-3ed82f12-1a1d-4412-a9dd-8e1a902d88a1 req-5bc264dc-17ba-4bff-8674-81ebbe285c78 service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Received event network-vif-plugged-c9175401-a233-4208-989d-72f952608659 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:53:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3ed82f12-1a1d-4412-a9dd-8e1a902d88a1 req-5bc264dc-17ba-4bff-8674-81ebbe285c78 service nova] Acquiring lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3ed82f12-1a1d-4412-a9dd-8e1a902d88a1 req-5bc264dc-17ba-4bff-8674-81ebbe285c78 service nova] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3ed82f12-1a1d-4412-a9dd-8e1a902d88a1 req-5bc264dc-17ba-4bff-8674-81ebbe285c78 service nova] Lock "be9a6bab-6958-43bb-9ed8-a531e05ed98d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-3ed82f12-1a1d-4412-a9dd-8e1a902d88a1 req-5bc264dc-17ba-4bff-8674-81ebbe285c78 service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] No waiting events found dispatching network-vif-plugged-c9175401-a233-4208-989d-72f952608659 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:53:08 user nova-compute[74646]: WARNING nova.compute.manager [req-3ed82f12-1a1d-4412-a9dd-8e1a902d88a1 req-5bc264dc-17ba-4bff-8674-81ebbe285c78 service nova] [instance: be9a6bab-6958-43bb-9ed8-a531e05ed98d] Received unexpected event network-vif-plugged-c9175401-a233-4208-989d-72f952608659 for instance with vm_state deleted and task_state None.
Oct 26 15:53:09 user nova-compute[74646]: INFO nova.virt.block_device [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Booting with volume 67a3a413-6e2c-4467-a709-b564560091cd at /dev/vdc
Oct 26 15:53:09 user nova-compute[74646]: DEBUG os_brick.utils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[068f073a-de97-4535-9601-f6b6ec99f04f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5937c80-e30d-4808-9644-6129f8af97f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b01644-6b4e-4ac8-8edc-d7489f97b6a2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8726b6ff-ff90-4ad6-b94b-bf50c0955484]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:53:09 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:53:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ddfad1-5cb0-413f-8b99-628e939e0103]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG os_brick.utils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:53:09 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating existing volume attachment record: 9c7a81ff-013f-425d-b1c4-d41729a65c52 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:53:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:16 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:53:17 user nova-compute[74646]: INFO nova.compute.claims [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Claim successful on node user
Oct 26 15:53:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:53:17 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:53:17 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG nova.policy [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41bb4004c8444824bb91ff40a872c7cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9073433dc0b34618b5c52f010e49400e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:53:17 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Creating image(s)
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "/opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "/opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.178s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.178s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk 1073741824" returned: 0 in 0.055s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:18 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Successfully created port: 11891582-29b6-4bbc-ac85-8eb614bc6c8e {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:53:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.187s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:18 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:53:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:18 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Cannot resize image /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:53:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:53:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Ensure instance console log exists: /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:53:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Successfully updated port: 11891582-29b6-4bbc-ac85-8eb614bc6c8e {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "refresh_cache-8e30a4ad-5c27-4f92-8f1e-4ed081198588" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquired lock "refresh_cache-8e30a4ad-5c27-4f92-8f1e-4ed081198588" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-90bcea60-2e3d-4a02-8369-32dbbb6175ca req-b9dbe327-aae5-4e79-99ae-06c815d47cd1 service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Received event network-changed-11891582-29b6-4bbc-ac85-8eb614bc6c8e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-90bcea60-2e3d-4a02-8369-32dbbb6175ca req-b9dbe327-aae5-4e79-99ae-06c815d47cd1 service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Refreshing instance network info cache due to event network-changed-11891582-29b6-4bbc-ac85-8eb614bc6c8e. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-90bcea60-2e3d-4a02-8369-32dbbb6175ca req-b9dbe327-aae5-4e79-99ae-06c815d47cd1 service nova] Acquiring lock "refresh_cache-8e30a4ad-5c27-4f92-8f1e-4ed081198588" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Updating instance_info_cache with network_info: [{"id": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "address": "fa:16:3e:c2:f8:be", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11891582-29", "ovs_interfaceid": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Releasing lock "refresh_cache-8e30a4ad-5c27-4f92-8f1e-4ed081198588" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Instance network_info: |[{"id": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "address": "fa:16:3e:c2:f8:be", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11891582-29", "ovs_interfaceid": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-90bcea60-2e3d-4a02-8369-32dbbb6175ca req-b9dbe327-aae5-4e79-99ae-06c815d47cd1 service nova] Acquired lock "refresh_cache-8e30a4ad-5c27-4f92-8f1e-4ed081198588" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.network.neutron [req-90bcea60-2e3d-4a02-8369-32dbbb6175ca req-b9dbe327-aae5-4e79-99ae-06c815d47cd1 service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Refreshing network info cache for port 11891582-29b6-4bbc-ac85-8eb614bc6c8e {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Start _get_guest_xml network_info=[{"id": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "address": "fa:16:3e:c2:f8:be", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11891582-29", "ovs_interfaceid": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:53:19 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:53:19 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1330341957',display_name='tempest-VolumesActionsTest-instance-1330341957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1330341957',id=12,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9073433dc0b34618b5c52f010e49400e',ramdisk_id='',reservation_id='r-38h7qatv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1225783245',owner_user_name='tempest-VolumesActionsTest-1225783245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:53:17Z,user_data=None,user_id='41bb4004c8444824bb91ff40a872c7cd',uuid=8e30a4ad-5c27-4f92-8f1e-4ed081198588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "address": "fa:16:3e:c2:f8:be", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11891582-29", "ovs_interfaceid": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Converting VIF {"id": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "address": "fa:16:3e:c2:f8:be", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11891582-29", "ovs_interfaceid": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f8:be,bridge_name='br-int',has_traffic_filtering=True,id=11891582-29b6-4bbc-ac85-8eb614bc6c8e,network=Network(fdc4cebd-c95f-4365-86a0-09b4b4a847b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11891582-29') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.objects.instance [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e30a4ad-5c27-4f92-8f1e-4ed081198588 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:53:19 user nova-compute[74646]:   <uuid>8e30a4ad-5c27-4f92-8f1e-4ed081198588</uuid>
Oct 26 15:53:19 user nova-compute[74646]:   <name>instance-0000000c</name>
Oct 26 15:53:19 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:53:19 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:53:19 user nova-compute[74646]:   <metadata>
Oct 26 15:53:19 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:53:19 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:53:19 user nova-compute[74646]:       <nova:name>tempest-VolumesActionsTest-instance-1330341957</nova:name>
Oct 26 15:53:19 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:53:19</nova:creationTime>
Oct 26 15:53:19 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:53:19 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:53:19 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:53:19 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:53:19 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:53:19 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:53:19 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:53:19 user nova-compute[74646]:       <nova:owner>
Oct 26 15:53:19 user nova-compute[74646]:         <nova:user uuid="41bb4004c8444824bb91ff40a872c7cd">tempest-VolumesActionsTest-1225783245-project-member</nova:user>
Oct 26 15:53:19 user nova-compute[74646]:         <nova:project uuid="9073433dc0b34618b5c52f010e49400e">tempest-VolumesActionsTest-1225783245</nova:project>
Oct 26 15:53:19 user nova-compute[74646]:       </nova:owner>
Oct 26 15:53:19 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:53:19 user nova-compute[74646]:       <nova:ports>
Oct 26 15:53:19 user nova-compute[74646]:         <nova:port uuid="11891582-29b6-4bbc-ac85-8eb614bc6c8e">
Oct 26 15:53:19 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 15:53:19 user nova-compute[74646]:         </nova:port>
Oct 26 15:53:19 user nova-compute[74646]:       </nova:ports>
Oct 26 15:53:19 user nova-compute[74646]:     </nova:instance>
Oct 26 15:53:19 user nova-compute[74646]:   </metadata>
Oct 26 15:53:19 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:53:19 user nova-compute[74646]:     <system>
Oct 26 15:53:19 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:53:19 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:53:19 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:53:19 user nova-compute[74646]:       <entry name="serial">8e30a4ad-5c27-4f92-8f1e-4ed081198588</entry>
Oct 26 15:53:19 user nova-compute[74646]:       <entry name="uuid">8e30a4ad-5c27-4f92-8f1e-4ed081198588</entry>
Oct 26 15:53:19 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:53:19 user nova-compute[74646]:     </system>
Oct 26 15:53:19 user nova-compute[74646]:   </sysinfo>
Oct 26 15:53:19 user nova-compute[74646]:   <os>
Oct 26 15:53:19 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:53:19 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:53:19 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:53:19 user nova-compute[74646]:   </os>
Oct 26 15:53:19 user nova-compute[74646]:   <features>
Oct 26 15:53:19 user nova-compute[74646]:     <acpi/>
Oct 26 15:53:19 user nova-compute[74646]:     <apic/>
Oct 26 15:53:19 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:53:19 user nova-compute[74646]:   </features>
Oct 26 15:53:19 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:53:19 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:53:19 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:53:19 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:53:19 user nova-compute[74646]:   </clock>
Oct 26 15:53:19 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:53:19 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:53:19 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:53:19 user nova-compute[74646]:   </cpu>
Oct 26 15:53:19 user nova-compute[74646]:   <devices>
Oct 26 15:53:19 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:53:19 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:53:19 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk"/>
Oct 26 15:53:19 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:53:19 user nova-compute[74646]:     </disk>
Oct 26 15:53:19 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:53:19 user nova-compute[74646]:       <mac address="fa:16:3e:c2:f8:be"/>
Oct 26 15:53:19 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:53:19 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:53:19 user nova-compute[74646]:       <target dev="tap11891582-29"/>
Oct 26 15:53:19 user nova-compute[74646]:     </interface>
Oct 26 15:53:19 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:53:19 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/console.log" append="off"/>
Oct 26 15:53:19 user nova-compute[74646]:     </serial>
Oct 26 15:53:19 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:53:19 user nova-compute[74646]:     <video>
Oct 26 15:53:19 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:53:19 user nova-compute[74646]:     </video>
Oct 26 15:53:19 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:53:19 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:53:19 user nova-compute[74646]:     </rng>
Oct 26 15:53:19 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:53:19 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:53:19 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:53:19 user nova-compute[74646]:     </memballoon>
Oct 26 15:53:19 user nova-compute[74646]:   </devices>
Oct 26 15:53:19 user nova-compute[74646]: </domain>
Oct 26 15:53:19 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1330341957',display_name='tempest-VolumesActionsTest-instance-1330341957',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1330341957',id=12,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9073433dc0b34618b5c52f010e49400e',ramdisk_id='',reservation_id='r-38h7qatv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1225783245',owner_user_name='tempest-VolumesActionsTest-1225783245-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:53:17Z,user_data=None,user_id='41bb4004c8444824bb91ff40a872c7cd',uuid=8e30a4ad-5c27-4f92-8f1e-4ed081198588,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "address": "fa:16:3e:c2:f8:be", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11891582-29", "ovs_interfaceid": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Converting VIF {"id": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "address": "fa:16:3e:c2:f8:be", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11891582-29", "ovs_interfaceid": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f8:be,bridge_name='br-int',has_traffic_filtering=True,id=11891582-29b6-4bbc-ac85-8eb614bc6c8e,network=Network(fdc4cebd-c95f-4365-86a0-09b4b4a847b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11891582-29') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG os_vif [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f8:be,bridge_name='br-int',has_traffic_filtering=True,id=11891582-29b6-4bbc-ac85-8eb614bc6c8e,network=Network(fdc4cebd-c95f-4365-86a0-09b4b4a847b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11891582-29') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8cefd991-0e82-58d0-9284-d1f203ed855e', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11891582-29, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11891582-29, col_values=(('qos', UUID('9025c815-1c0f-4d48-af46-94217796b94b')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11891582-29, col_values=(('external_ids', {'iface-id': '11891582-29b6-4bbc-ac85-8eb614bc6c8e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:f8:be', 'vm-uuid': '8e30a4ad-5c27-4f92-8f1e-4ed081198588'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:19 user nova-compute[74646]: INFO os_vif [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:f8:be,bridge_name='br-int',has_traffic_filtering=True,id=11891582-29b6-4bbc-ac85-8eb614bc6c8e,network=Network(fdc4cebd-c95f-4365-86a0-09b4b4a847b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11891582-29')
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:53:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] No VIF found with MAC fa:16:3e:c2:f8:be, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:53:20 user nova-compute[74646]: DEBUG nova.network.neutron [req-90bcea60-2e3d-4a02-8369-32dbbb6175ca req-b9dbe327-aae5-4e79-99ae-06c815d47cd1 service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Updated VIF entry in instance network info cache for port 11891582-29b6-4bbc-ac85-8eb614bc6c8e. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:53:20 user nova-compute[74646]: DEBUG nova.network.neutron [req-90bcea60-2e3d-4a02-8369-32dbbb6175ca req-b9dbe327-aae5-4e79-99ae-06c815d47cd1 service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Updating instance_info_cache with network_info: [{"id": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "address": "fa:16:3e:c2:f8:be", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11891582-29", "ovs_interfaceid": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:53:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-90bcea60-2e3d-4a02-8369-32dbbb6175ca req-b9dbe327-aae5-4e79-99ae-06c815d47cd1 service nova] Releasing lock "refresh_cache-8e30a4ad-5c27-4f92-8f1e-4ed081198588" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:53:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-e1b99b9c-7ea2-463b-b1db-b57b56ef7dc7 req-8675b218-a521-42ee-97c4-e5d39e3fbdd0 service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Received event network-vif-plugged-11891582-29b6-4bbc-ac85-8eb614bc6c8e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:53:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e1b99b9c-7ea2-463b-b1db-b57b56ef7dc7 req-8675b218-a521-42ee-97c4-e5d39e3fbdd0 service nova] Acquiring lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e1b99b9c-7ea2-463b-b1db-b57b56ef7dc7 req-8675b218-a521-42ee-97c4-e5d39e3fbdd0 service nova] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e1b99b9c-7ea2-463b-b1db-b57b56ef7dc7 req-8675b218-a521-42ee-97c4-e5d39e3fbdd0 service nova] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-e1b99b9c-7ea2-463b-b1db-b57b56ef7dc7 req-8675b218-a521-42ee-97c4-e5d39e3fbdd0 service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] No waiting events found dispatching network-vif-plugged-11891582-29b6-4bbc-ac85-8eb614bc6c8e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:53:21 user nova-compute[74646]: WARNING nova.compute.manager [req-e1b99b9c-7ea2-463b-b1db-b57b56ef7dc7 req-8675b218-a521-42ee-97c4-e5d39e3fbdd0 service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Received unexpected event network-vif-plugged-11891582-29b6-4bbc-ac85-8eb614bc6c8e for instance with vm_state building and task_state spawning.
Oct 26 15:53:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Didn't find any instances for network info cache update. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:53:23 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Instance spawned successfully.
Oct 26 15:53:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG nova.compute.manager [req-6a2283e0-8326-46b0-9481-1eca793c088b req-7e570924-f1ce-4bd5-b996-cd4bc7a9151d service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Received event network-vif-plugged-11891582-29b6-4bbc-ac85-8eb614bc6c8e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6a2283e0-8326-46b0-9481-1eca793c088b req-7e570924-f1ce-4bd5-b996-cd4bc7a9151d service nova] Acquiring lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6a2283e0-8326-46b0-9481-1eca793c088b req-7e570924-f1ce-4bd5-b996-cd4bc7a9151d service nova] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6a2283e0-8326-46b0-9481-1eca793c088b req-7e570924-f1ce-4bd5-b996-cd4bc7a9151d service nova] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG nova.compute.manager [req-6a2283e0-8326-46b0-9481-1eca793c088b req-7e570924-f1ce-4bd5-b996-cd4bc7a9151d service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] No waiting events found dispatching network-vif-plugged-11891582-29b6-4bbc-ac85-8eb614bc6c8e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:53:23 user nova-compute[74646]: WARNING nova.compute.manager [req-6a2283e0-8326-46b0-9481-1eca793c088b req-7e570924-f1ce-4bd5-b996-cd4bc7a9151d service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Received unexpected event network-vif-plugged-11891582-29b6-4bbc-ac85-8eb614bc6c8e for instance with vm_state building and task_state spawning.
Oct 26 15:53:23 user nova-compute[74646]: INFO nova.compute.manager [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Took 6.12 seconds to spawn the instance on the hypervisor.
Oct 26 15:53:23 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:23 user nova-compute[74646]: INFO nova.compute.manager [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Took 6.82 seconds to build instance.
Oct 26 15:53:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a88ce4f8-01e2-42d9-95f2-c9fe5db2a76b tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.938s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:24 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:53:24 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:53:24 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8429MB free_disk=25.769580841064453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1c5d5313-72f0-4f49-83b7-f277d5da4191 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 5e42f38e-e10f-43b7-89ab-ab22addfcf95 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b8a97889-399d-46ec-ac9a-8d2db324ce69 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance ea252f48-c697-445e-bfc8-4a919b23aa83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 8e30a4ad-5c27-4f92-8f1e-4ed081198588 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:27 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b8a97889-399d-46ec-ac9a-8d2db324ce69 is timed out.
Oct 26 15:53:27 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Successfully detached device vdb from instance b8a97889-399d-46ec-ac9a-8d2db324ce69 from the live domain config.
Oct 26 15:53:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ulwqvmXo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:53:27 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1c36e7-c864-48ba-bce0-225da92274e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:53:27 user nova-compute[74646]: No targets found.
Oct 26 15:53:27 user nova-compute[74646]: iSNS:
Oct 26 15:53:27 user nova-compute[74646]: No targets found.
Oct 26 15:53:27 user nova-compute[74646]: STATIC:
Oct 26 15:53:27 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e
Oct 26 15:53:27 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:53:27 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:53:27 user nova-compute[74646]: FIRMWARE:
Oct 26 15:53:27 user nova-compute[74646]: No targets found.
Oct 26 15:53:27 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:53:27 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:53:27 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d13c16-2e64-4e5e-8eb2-e8c829c3018a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1a6d28-6563-447a-bd2f-f82a91e89abd]: (4, ('tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:53:27 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsi session list stdout=tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e (non-flash)
Oct 26 15:53:27 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e82e7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e'): ({'sdc'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Removing single pathed devices sdc {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[df73ac42-c9ab-4d6f-9ec2-bdd24ff9959a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2176ffc-cd83-403b-a4a9-620683743544]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Flushing IO for device /dev/sdc {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d86656-b5ca-4339-977a-970022c4ca8b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea03688-f4ff-4b19-a2e6-858d7a4b1670]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e62892f-4e8b-4fce-84cc-b746cfb8dd3f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2859b2-006a-47b1-aaad-2f0d75356e79]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260]
Oct 26 15:53:27 user nova-compute[74646]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e, portal: 172.16.0.220,3260] successful.
Oct 26 15:53:27 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:53:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:53:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b9bdc8dd-f81c-4ea9-8084-c12c37e4f32e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:53:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf11f094-e0cd-4524-8506-18e2000acd80]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:53:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:53:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:53:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] <== disconnect_volume: return (311ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:53:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:53:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:34 user nova-compute[74646]: DEBUG nova.objects.instance [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lazy-loading 'flavor' on Instance uuid b8a97889-399d-46ec-ac9a-8d2db324ce69 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:53:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-eaad89bb-ba85-4e6b-a92e-3e9b556c5be4 tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.944s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:53:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 15:53:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 15:53:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 15:53:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:35 user nova-compute[74646]: INFO nova.compute.manager [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Terminating instance
Oct 26 15:53:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG nova.compute.manager [req-48280c81-0381-408c-8d25-e4e0acc23017 req-f273b678-6125-4d90-96a0-95186da80ef7 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Received event network-vif-unplugged-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-48280c81-0381-408c-8d25-e4e0acc23017 req-f273b678-6125-4d90-96a0-95186da80ef7 service nova] Acquiring lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-48280c81-0381-408c-8d25-e4e0acc23017 req-f273b678-6125-4d90-96a0-95186da80ef7 service nova] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-48280c81-0381-408c-8d25-e4e0acc23017 req-f273b678-6125-4d90-96a0-95186da80ef7 service nova] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG nova.compute.manager [req-48280c81-0381-408c-8d25-e4e0acc23017 req-f273b678-6125-4d90-96a0-95186da80ef7 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] No waiting events found dispatching network-vif-unplugged-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:53:35 user nova-compute[74646]: DEBUG nova.compute.manager [req-48280c81-0381-408c-8d25-e4e0acc23017 req-f273b678-6125-4d90-96a0-95186da80ef7 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Received event network-vif-unplugged-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:36 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Instance destroyed successfully.
Oct 26 15:53:36 user nova-compute[74646]: DEBUG nova.objects.instance [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lazy-loading 'resources' on Instance uuid 5e42f38e-e10f-43b7-89ab-ab22addfcf95 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:48:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1043468833',display_name='tempest-AttachVolumeTestJSON-server-1043468833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1043468833',id=2,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHn8rm45Kj9Re6BL30H2w6DxBxC/ij4uFpyMPHadSUiWneGNBRJdFMtPDT/ID3tOj17UNmJkBabHKoH4/5yows/aVTjy9mo3JiVH8WBYMuekLmGfJxRFUWT2mM0nAS6kTw==',key_name='tempest-keypair-836871958',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:48:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5888676639c54df88e50f01bf81d3cb8',ramdisk_id='',reservation_id='r-k9gjc6pl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1526735619',owner_user_name='tempest-AttachVolumeTestJSON-1526735619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:48:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f080f51ac04c23a489e5dc115a1ba1',uuid=5e42f38e-e10f-43b7-89ab-ab22addfcf95,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "address": "fa:16:3e:81:8c:c3", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59d9ca3-b8", "ovs_interfaceid": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Converting VIF {"id": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "address": "fa:16:3e:81:8c:c3", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape59d9ca3-b8", "ovs_interfaceid": "e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:81:8c:c3,bridge_name='br-int',has_traffic_filtering=True,id=e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc,network=Network(4a154aa2-0773-459f-b145-b76412506085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59d9ca3-b8') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG os_vif [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:8c:c3,bridge_name='br-int',has_traffic_filtering=True,id=e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc,network=Network(4a154aa2-0773-459f-b145-b76412506085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59d9ca3-b8') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape59d9ca3-b8, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=071765d6-bc0b-4e31-8b97-c8f8a7d25bd4) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:53:36 user nova-compute[74646]: INFO os_vif [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:81:8c:c3,bridge_name='br-int',has_traffic_filtering=True,id=e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc,network=Network(4a154aa2-0773-459f-b145-b76412506085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape59d9ca3-b8')
Oct 26 15:53:36 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Deleting instance files /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95_del
Oct 26 15:53:36 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Deletion of /opt/stack/data/nova/instances/5e42f38e-e10f-43b7-89ab-ab22addfcf95_del complete
Oct 26 15:53:36 user nova-compute[74646]: INFO nova.compute.manager [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 26 15:53:36 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 15:53:36 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 15:53:37 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:53:37 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Took 0.83 seconds to deallocate network for instance.
Oct 26 15:53:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-1c94a9a4-fe9b-47e7-82f3-aa87a9df6b2e req-8c009f91-40fb-455a-bdd1-ca4a74cacb97 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Received event network-vif-deleted-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:53:37 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:53:37 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:53:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:37 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Deleted allocations for instance 5e42f38e-e10f-43b7-89ab-ab22addfcf95
Oct 26 15:53:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00a817d0-e4fa-4f36-b81a-19ee6626cf2a tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.111s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-0a330f2e-b5bb-455e-a8da-9a45d62b9974 req-ab03e7c5-3fd9-4ed3-837f-f1f8ac2ddef2 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Received event network-vif-plugged-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:53:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0a330f2e-b5bb-455e-a8da-9a45d62b9974 req-ab03e7c5-3fd9-4ed3-837f-f1f8ac2ddef2 service nova] Acquiring lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0a330f2e-b5bb-455e-a8da-9a45d62b9974 req-ab03e7c5-3fd9-4ed3-837f-f1f8ac2ddef2 service nova] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0a330f2e-b5bb-455e-a8da-9a45d62b9974 req-ab03e7c5-3fd9-4ed3-837f-f1f8ac2ddef2 service nova] Lock "5e42f38e-e10f-43b7-89ab-ab22addfcf95-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-0a330f2e-b5bb-455e-a8da-9a45d62b9974 req-ab03e7c5-3fd9-4ed3-837f-f1f8ac2ddef2 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] No waiting events found dispatching network-vif-plugged-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:53:37 user nova-compute[74646]: WARNING nova.compute.manager [req-0a330f2e-b5bb-455e-a8da-9a45d62b9974 req-ab03e7c5-3fd9-4ed3-837f-f1f8ac2ddef2 service nova] [instance: 5e42f38e-e10f-43b7-89ab-ab22addfcf95] Received unexpected event network-vif-plugged-e59d9ca3-b8b2-43e7-9926-40f8f60f2dfc for instance with vm_state deleted and task_state None.
Oct 26 15:53:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:57 user nova-compute[74646]: INFO nova.compute.manager [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Terminating instance
Oct 26 15:53:57 user nova-compute[74646]: DEBUG nova.compute.manager [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 15:53:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-5f736584-c6bd-48cd-bc83-e29020b5e4b6 req-e0b0d156-d404-4bd8-95db-d9b4b5802fca service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Received event network-vif-unplugged-9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5f736584-c6bd-48cd-bc83-e29020b5e4b6 req-e0b0d156-d404-4bd8-95db-d9b4b5802fca service nova] Acquiring lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5f736584-c6bd-48cd-bc83-e29020b5e4b6 req-e0b0d156-d404-4bd8-95db-d9b4b5802fca service nova] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5f736584-c6bd-48cd-bc83-e29020b5e4b6 req-e0b0d156-d404-4bd8-95db-d9b4b5802fca service nova] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-5f736584-c6bd-48cd-bc83-e29020b5e4b6 req-e0b0d156-d404-4bd8-95db-d9b4b5802fca service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] No waiting events found dispatching network-vif-unplugged-9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-5f736584-c6bd-48cd-bc83-e29020b5e4b6 req-e0b0d156-d404-4bd8-95db-d9b4b5802fca service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Received event network-vif-unplugged-9c1652a6-3a41-44b7-8c28-52dcbbf07212 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:58 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Instance destroyed successfully.
Oct 26 15:53:58 user nova-compute[74646]: DEBUG nova.objects.instance [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lazy-loading 'resources' on Instance uuid b8a97889-399d-46ec-ac9a-8d2db324ce69 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:49:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1095028569',display_name='tempest-TestVolumeSwap-server-1095028569',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1095028569',id=7,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHx82WVz4hG9BbgLFDLFCM6ebksOzi/Glt7d9bYFhR7k3NYtXWIpCjSMit8JL6ERcT4WHhLVsaGX1g6cdwqvs1B7ymhC9t8YE7mYoQjBd/kqlvyggbnB73FUTa5UjU2TQA==',key_name='tempest-keypair-315809944',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:49:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='796b5380a64145f0985b670b051a47d9',ramdisk_id='',reservation_id='r-c1pja9r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-485599319',owner_user_name='tempest-TestVolumeSwap-485599319-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:49:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72a2d301a6a74de5be38e9b31c87fa26',uuid=b8a97889-399d-46ec-ac9a-8d2db324ce69,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "address": "fa:16:3e:a7:f3:71", "network": {"id": "1ed7e661-ac84-4aab-8f25-02ffc06fbd62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-461114934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796b5380a64145f0985b670b051a47d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1652a6-3a", "ovs_interfaceid": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Converting VIF {"id": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "address": "fa:16:3e:a7:f3:71", "network": {"id": "1ed7e661-ac84-4aab-8f25-02ffc06fbd62", "bridge": "br-int", "label": "tempest-TestVolumeSwap-461114934-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "796b5380a64145f0985b670b051a47d9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9c1652a6-3a", "ovs_interfaceid": "9c1652a6-3a41-44b7-8c28-52dcbbf07212", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f3:71,bridge_name='br-int',has_traffic_filtering=True,id=9c1652a6-3a41-44b7-8c28-52dcbbf07212,network=Network(1ed7e661-ac84-4aab-8f25-02ffc06fbd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1652a6-3a') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG os_vif [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f3:71,bridge_name='br-int',has_traffic_filtering=True,id=9c1652a6-3a41-44b7-8c28-52dcbbf07212,network=Network(1ed7e661-ac84-4aab-8f25-02ffc06fbd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1652a6-3a') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9c1652a6-3a, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8c7e086b-b394-45a9-82c0-5d548ab9afa0) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:53:58 user nova-compute[74646]: INFO os_vif [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:f3:71,bridge_name='br-int',has_traffic_filtering=True,id=9c1652a6-3a41-44b7-8c28-52dcbbf07212,network=Network(1ed7e661-ac84-4aab-8f25-02ffc06fbd62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9c1652a6-3a')
Oct 26 15:53:58 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Deleting instance files /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69_del
Oct 26 15:53:58 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Deletion of /opt/stack/data/nova/instances/b8a97889-399d-46ec-ac9a-8d2db324ce69_del complete
Oct 26 15:53:58 user nova-compute[74646]: INFO nova.compute.manager [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 26 15:53:58 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 15:53:58 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 15:53:59 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:53:59 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Took 0.88 seconds to deallocate network for instance.
Oct 26 15:53:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:53:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:53:59 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:53:59 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:53:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.284s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:53:59 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Deleted allocations for instance b8a97889-399d-46ec-ac9a-8d2db324ce69
Oct 26 15:53:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-008b33e4-ced2-46be-bfd4-d47943ee815f tempest-TestVolumeSwap-485599319 tempest-TestVolumeSwap-485599319-project-member] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.315s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-0af05919-1398-450f-83f3-a48d47ce46c9 req-997f9380-3775-4f03-a034-cdfa48685211 service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Received event network-vif-plugged-9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0af05919-1398-450f-83f3-a48d47ce46c9 req-997f9380-3775-4f03-a034-cdfa48685211 service nova] Acquiring lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0af05919-1398-450f-83f3-a48d47ce46c9 req-997f9380-3775-4f03-a034-cdfa48685211 service nova] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0af05919-1398-450f-83f3-a48d47ce46c9 req-997f9380-3775-4f03-a034-cdfa48685211 service nova] Lock "b8a97889-399d-46ec-ac9a-8d2db324ce69-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-0af05919-1398-450f-83f3-a48d47ce46c9 req-997f9380-3775-4f03-a034-cdfa48685211 service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] No waiting events found dispatching network-vif-plugged-9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:54:00 user nova-compute[74646]: WARNING nova.compute.manager [req-0af05919-1398-450f-83f3-a48d47ce46c9 req-997f9380-3775-4f03-a034-cdfa48685211 service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Received unexpected event network-vif-plugged-9c1652a6-3a41-44b7-8c28-52dcbbf07212 for instance with vm_state deleted and task_state None.
Oct 26 15:54:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-0af05919-1398-450f-83f3-a48d47ce46c9 req-997f9380-3775-4f03-a034-cdfa48685211 service nova] [instance: b8a97889-399d-46ec-ac9a-8d2db324ce69] Received event network-vif-deleted-9c1652a6-3a41-44b7-8c28-52dcbbf07212 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:12 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:54:12 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Cleaning up deleted instances {{(pid=74646) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 15:54:12 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] There are 0 instances to clean {{(pid=74646) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 15:54:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:14 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:54:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:14 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:54:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:16 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:54:16 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:54:16 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8540MB free_disk=25.792316436767578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:54:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:16 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1c5d5313-72f0-4f49-83b7-f277d5da4191 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:54:16 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:54:16 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance ea252f48-c697-445e-bfc8-4a919b23aa83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:54:16 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 8e30a4ad-5c27-4f92-8f1e-4ed081198588 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:54:16 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:54:16 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:54:16 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:54:16 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:54:16 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:54:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:17 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:54:17 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:54:17 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:54:17 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:54:17 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:54:17 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:54:18 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:54:18 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:54:18 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Rebuilding the list of instances to heal {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 15:54:18 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Skipping network cache update for instance because it is Building. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 15:54:18 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Skipping network cache update for instance because it is Building. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 15:54:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:54:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:54:18 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 15:54:18 user nova-compute[74646]: DEBUG nova.objects.instance [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lazy-loading 'info_cache' on Instance uuid 1c5d5313-72f0-4f49-83b7-f277d5da4191 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:54:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:19 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Updating instance_info_cache with network_info: [{"id": "529d94bf-3278-41ad-b2c1-522b68db2421", "address": "fa:16:3e:2e:e2:50", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529d94bf-32", "ovs_interfaceid": "529d94bf-3278-41ad-b2c1-522b68db2421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:54:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:54:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 15:54:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:54:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:54:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:54:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:54:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Cleaning up deleted instances with incomplete migration  {{(pid=74646) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 15:54:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:54:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:54:22 user nova-compute[74646]: INFO nova.compute.claims [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Claim successful on node user
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Refreshing inventories for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Updating ProviderTree inventory for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Updating inventory in ProviderTree for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Refreshing aggregate associations for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6, aggregates: None {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Refreshing trait associations for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.network.neutron [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:54:22 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.policy [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9311cee7c04e45ddbae6f16ba43eed2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8788e95cc244f98b0ff8d593d1e067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:54:22 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Creating image(s)
Oct 26 15:54:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "/opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "/opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "/opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.182s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.183s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk 1073741824" returned: 0 in 0.049s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG nova.network.neutron [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Successfully created port: ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.186s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Cannot resize image /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Ensure instance console log exists: /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:24 user nova-compute[74646]: DEBUG nova.network.neutron [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Successfully updated port: ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:54:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:54:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquired lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:54:24 user nova-compute[74646]: DEBUG nova.network.neutron [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:54:24 user nova-compute[74646]: DEBUG nova.compute.manager [req-4c0d26ea-eb58-4b90-a37f-9972fab8ad8f req-b17b7bdc-92cd-4c68-b97f-0a154377f33d service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received event network-changed-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:24 user nova-compute[74646]: DEBUG nova.compute.manager [req-4c0d26ea-eb58-4b90-a37f-9972fab8ad8f req-b17b7bdc-92cd-4c68-b97f-0a154377f33d service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Refreshing instance network info cache due to event network-changed-ade5aae8-edfd-4f46-b943-e261afcc76f0. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:54:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4c0d26ea-eb58-4b90-a37f-9972fab8ad8f req-b17b7bdc-92cd-4c68-b97f-0a154377f33d service nova] Acquiring lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:54:24 user nova-compute[74646]: DEBUG nova.network.neutron [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:54:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.network.neutron [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updating instance_info_cache with network_info: [{"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Releasing lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.compute.manager [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Instance network_info: |[{"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4c0d26ea-eb58-4b90-a37f-9972fab8ad8f req-b17b7bdc-92cd-4c68-b97f-0a154377f33d service nova] Acquired lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.network.neutron [req-4c0d26ea-eb58-4b90-a37f-9972fab8ad8f req-b17b7bdc-92cd-4c68-b97f-0a154377f33d service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Refreshing network info cache for port ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Start _get_guest_xml network_info=[{"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:54:25 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:54:25 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1900340032',display_name='tempest-ServerActionsTestOtherA-server-1900340032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1900340032',id=13,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFpQMuDQ9yV5cYwbhkTyRLOjZZ0Tl/sjjENeyylssja83c6EpW+JftZQ9mXXtyfrIqGGnek7tn477+zNOt3iNR5IPo2YdOD8TzgfFC3ul9nIufuOchmOZ60R0hjnHQdyg==',key_name='tempest-keypair-1269718539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-70neg647',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:54:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=9f40ed75-7cf2-4f13-95cb-5d23c8ce8497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ec:35,bridge_name='br-int',has_traffic_filtering=True,id=ade5aae8-edfd-4f46-b943-e261afcc76f0,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade5aae8-ed') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.objects.instance [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:54:25 user nova-compute[74646]:   <uuid>9f40ed75-7cf2-4f13-95cb-5d23c8ce8497</uuid>
Oct 26 15:54:25 user nova-compute[74646]:   <name>instance-0000000d</name>
Oct 26 15:54:25 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:54:25 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:54:25 user nova-compute[74646]:   <metadata>
Oct 26 15:54:25 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:54:25 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:54:25 user nova-compute[74646]:       <nova:name>tempest-ServerActionsTestOtherA-server-1900340032</nova:name>
Oct 26 15:54:25 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:54:25</nova:creationTime>
Oct 26 15:54:25 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:54:25 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:54:25 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:54:25 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:54:25 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:54:25 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:54:25 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:54:25 user nova-compute[74646]:       <nova:owner>
Oct 26 15:54:25 user nova-compute[74646]:         <nova:user uuid="9311cee7c04e45ddbae6f16ba43eed2e">tempest-ServerActionsTestOtherA-333958340-project-member</nova:user>
Oct 26 15:54:25 user nova-compute[74646]:         <nova:project uuid="6c8788e95cc244f98b0ff8d593d1e067">tempest-ServerActionsTestOtherA-333958340</nova:project>
Oct 26 15:54:25 user nova-compute[74646]:       </nova:owner>
Oct 26 15:54:25 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:54:25 user nova-compute[74646]:       <nova:ports>
Oct 26 15:54:25 user nova-compute[74646]:         <nova:port uuid="ade5aae8-edfd-4f46-b943-e261afcc76f0">
Oct 26 15:54:25 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 15:54:25 user nova-compute[74646]:         </nova:port>
Oct 26 15:54:25 user nova-compute[74646]:       </nova:ports>
Oct 26 15:54:25 user nova-compute[74646]:     </nova:instance>
Oct 26 15:54:25 user nova-compute[74646]:   </metadata>
Oct 26 15:54:25 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:54:25 user nova-compute[74646]:     <system>
Oct 26 15:54:25 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:54:25 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:54:25 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:54:25 user nova-compute[74646]:       <entry name="serial">9f40ed75-7cf2-4f13-95cb-5d23c8ce8497</entry>
Oct 26 15:54:25 user nova-compute[74646]:       <entry name="uuid">9f40ed75-7cf2-4f13-95cb-5d23c8ce8497</entry>
Oct 26 15:54:25 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:54:25 user nova-compute[74646]:     </system>
Oct 26 15:54:25 user nova-compute[74646]:   </sysinfo>
Oct 26 15:54:25 user nova-compute[74646]:   <os>
Oct 26 15:54:25 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:54:25 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:54:25 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:54:25 user nova-compute[74646]:   </os>
Oct 26 15:54:25 user nova-compute[74646]:   <features>
Oct 26 15:54:25 user nova-compute[74646]:     <acpi/>
Oct 26 15:54:25 user nova-compute[74646]:     <apic/>
Oct 26 15:54:25 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:54:25 user nova-compute[74646]:   </features>
Oct 26 15:54:25 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:54:25 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:54:25 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:54:25 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:54:25 user nova-compute[74646]:   </clock>
Oct 26 15:54:25 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:54:25 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:54:25 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:54:25 user nova-compute[74646]:   </cpu>
Oct 26 15:54:25 user nova-compute[74646]:   <devices>
Oct 26 15:54:25 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:54:25 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:54:25 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk"/>
Oct 26 15:54:25 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:54:25 user nova-compute[74646]:     </disk>
Oct 26 15:54:25 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:54:25 user nova-compute[74646]:       <mac address="fa:16:3e:6c:ec:35"/>
Oct 26 15:54:25 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:54:25 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:54:25 user nova-compute[74646]:       <target dev="tapade5aae8-ed"/>
Oct 26 15:54:25 user nova-compute[74646]:     </interface>
Oct 26 15:54:25 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:54:25 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/console.log" append="off"/>
Oct 26 15:54:25 user nova-compute[74646]:     </serial>
Oct 26 15:54:25 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:54:25 user nova-compute[74646]:     <video>
Oct 26 15:54:25 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:54:25 user nova-compute[74646]:     </video>
Oct 26 15:54:25 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:54:25 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:54:25 user nova-compute[74646]:     </rng>
Oct 26 15:54:25 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:54:25 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:54:25 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:54:25 user nova-compute[74646]:     </memballoon>
Oct 26 15:54:25 user nova-compute[74646]:   </devices>
Oct 26 15:54:25 user nova-compute[74646]: </domain>
Oct 26 15:54:25 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1900340032',display_name='tempest-ServerActionsTestOtherA-server-1900340032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1900340032',id=13,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFpQMuDQ9yV5cYwbhkTyRLOjZZ0Tl/sjjENeyylssja83c6EpW+JftZQ9mXXtyfrIqGGnek7tn477+zNOt3iNR5IPo2YdOD8TzgfFC3ul9nIufuOchmOZ60R0hjnHQdyg==',key_name='tempest-keypair-1269718539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-70neg647',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:54:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=9f40ed75-7cf2-4f13-95cb-5d23c8ce8497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ec:35,bridge_name='br-int',has_traffic_filtering=True,id=ade5aae8-edfd-4f46-b943-e261afcc76f0,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade5aae8-ed') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG os_vif [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ec:35,bridge_name='br-int',has_traffic_filtering=True,id=ade5aae8-edfd-4f46-b943-e261afcc76f0,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade5aae8-ed') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f44a915-251e-5f6e-99a6-c76d251dc277', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapade5aae8-ed, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapade5aae8-ed, col_values=(('qos', UUID('c7ac4ad6-a361-474d-852f-6c1968a46931')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapade5aae8-ed, col_values=(('external_ids', {'iface-id': 'ade5aae8-edfd-4f46-b943-e261afcc76f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:ec:35', 'vm-uuid': '9f40ed75-7cf2-4f13-95cb-5d23c8ce8497'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:25 user nova-compute[74646]: INFO os_vif [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:ec:35,bridge_name='br-int',has_traffic_filtering=True,id=ade5aae8-edfd-4f46-b943-e261afcc76f0,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade5aae8-ed')
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] No VIF found with MAC fa:16:3e:6c:ec:35, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.network.neutron [req-4c0d26ea-eb58-4b90-a37f-9972fab8ad8f req-b17b7bdc-92cd-4c68-b97f-0a154377f33d service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updated VIF entry in instance network info cache for port ade5aae8-edfd-4f46-b943-e261afcc76f0. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG nova.network.neutron [req-4c0d26ea-eb58-4b90-a37f-9972fab8ad8f req-b17b7bdc-92cd-4c68-b97f-0a154377f33d service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updating instance_info_cache with network_info: [{"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:54:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4c0d26ea-eb58-4b90-a37f-9972fab8ad8f req-b17b7bdc-92cd-4c68-b97f-0a154377f33d service nova] Releasing lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:54:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-d15516bb-fa4a-4277-95ce-69c973cb9f61 req-59cce35d-533a-4b9d-822b-b6d75ceb7f93 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received event network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d15516bb-fa4a-4277-95ce-69c973cb9f61 req-59cce35d-533a-4b9d-822b-b6d75ceb7f93 service nova] Acquiring lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d15516bb-fa4a-4277-95ce-69c973cb9f61 req-59cce35d-533a-4b9d-822b-b6d75ceb7f93 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d15516bb-fa4a-4277-95ce-69c973cb9f61 req-59cce35d-533a-4b9d-822b-b6d75ceb7f93 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-d15516bb-fa4a-4277-95ce-69c973cb9f61 req-59cce35d-533a-4b9d-822b-b6d75ceb7f93 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] No waiting events found dispatching network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:54:27 user nova-compute[74646]: WARNING nova.compute.manager [req-d15516bb-fa4a-4277-95ce-69c973cb9f61 req-59cce35d-533a-4b9d-822b-b6d75ceb7f93 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received unexpected event network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 for instance with vm_state building and task_state spawning.
Oct 26 15:54:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:28 user nova-compute[74646]: DEBUG nova.compute.manager [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:54:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:54:28 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Instance spawned successfully.
Oct 26 15:54:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:54:29 user nova-compute[74646]: INFO nova.compute.manager [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Took 6.13 seconds to spawn the instance on the hypervisor.
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-1fc7ab7c-663d-4f5d-96d2-ef6137147ab3 req-77a34a8e-bc72-4182-b434-33730b868f23 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received event network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1fc7ab7c-663d-4f5d-96d2-ef6137147ab3 req-77a34a8e-bc72-4182-b434-33730b868f23 service nova] Acquiring lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1fc7ab7c-663d-4f5d-96d2-ef6137147ab3 req-77a34a8e-bc72-4182-b434-33730b868f23 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1fc7ab7c-663d-4f5d-96d2-ef6137147ab3 req-77a34a8e-bc72-4182-b434-33730b868f23 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-1fc7ab7c-663d-4f5d-96d2-ef6137147ab3 req-77a34a8e-bc72-4182-b434-33730b868f23 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] No waiting events found dispatching network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:54:29 user nova-compute[74646]: WARNING nova.compute.manager [req-1fc7ab7c-663d-4f5d-96d2-ef6137147ab3 req-77a34a8e-bc72-4182-b434-33730b868f23 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received unexpected event network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 for instance with vm_state building and task_state spawning.
Oct 26 15:54:29 user nova-compute[74646]: INFO nova.compute.manager [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Took 7.15 seconds to build instance.
Oct 26 15:54:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-80cba2df-1ed6-4bee-86b5-a1e8a875f96b tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.274s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:54:29 user nova-compute[74646]: INFO nova.compute.claims [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Claim successful on node user
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.421s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.network.neutron [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:54:29 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:54:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:54:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG nova.policy [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '18f080f51ac04c23a489e5dc115a1ba1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5888676639c54df88e50f01bf81d3cb8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:54:30 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Creating image(s)
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "/opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "/opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "/opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.194s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.237s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk 1073741824" returned: 0 in 0.061s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG nova.network.neutron [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Successfully created port: ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.241s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:54:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Cannot resize image /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Ensure instance console log exists: /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG nova.network.neutron [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Successfully updated port: ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "refresh_cache-5fbfcaaa-f050-473e-9e59-e48179a606e2" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquired lock "refresh_cache-5fbfcaaa-f050-473e-9e59-e48179a606e2" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG nova.network.neutron [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG nova.compute.manager [req-27c99d11-ecda-412d-a31a-e4c2ec2acc33 req-6b0d4ebc-6e56-44d9-89a8-2914af5fe026 service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Received event network-changed-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG nova.compute.manager [req-27c99d11-ecda-412d-a31a-e4c2ec2acc33 req-6b0d4ebc-6e56-44d9-89a8-2914af5fe026 service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Refreshing instance network info cache due to event network-changed-ff1d7189-1721-4f3b-9c25-2aa8f71d9577. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-27c99d11-ecda-412d-a31a-e4c2ec2acc33 req-6b0d4ebc-6e56-44d9-89a8-2914af5fe026 service nova] Acquiring lock "refresh_cache-5fbfcaaa-f050-473e-9e59-e48179a606e2" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG nova.network.neutron [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:54:31 user nova-compute[74646]: DEBUG nova.network.neutron [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Updating instance_info_cache with network_info: [{"id": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "address": "fa:16:3e:10:ee:9c", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff1d7189-17", "ovs_interfaceid": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Releasing lock "refresh_cache-5fbfcaaa-f050-473e-9e59-e48179a606e2" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.compute.manager [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Instance network_info: |[{"id": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "address": "fa:16:3e:10:ee:9c", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff1d7189-17", "ovs_interfaceid": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-27c99d11-ecda-412d-a31a-e4c2ec2acc33 req-6b0d4ebc-6e56-44d9-89a8-2914af5fe026 service nova] Acquired lock "refresh_cache-5fbfcaaa-f050-473e-9e59-e48179a606e2" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.network.neutron [req-27c99d11-ecda-412d-a31a-e4c2ec2acc33 req-6b0d4ebc-6e56-44d9-89a8-2914af5fe026 service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Refreshing network info cache for port ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Start _get_guest_xml network_info=[{"id": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "address": "fa:16:3e:10:ee:9c", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff1d7189-17", "ovs_interfaceid": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:54:32 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:54:32 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:54:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-781379095',display_name='tempest-AttachVolumeTestJSON-server-781379095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-781379095',id=14,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsXQE453uK0lLzjrYlR4DLEizoib5xh9odwhhyi+ohkUe1oujptzPPw6adTebnGGiKqHM3dtwPDy4kAxfTD8Zah+cdnpNCgYmPFZST5FAVpalPjLDvSFyjyrTpQboGUmA==',key_name='tempest-keypair-1651792393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5888676639c54df88e50f01bf81d3cb8',ramdisk_id='',reservation_id='r-rfs5tpgc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1526735619',owner_user_name='tempest-AttachVolumeTestJSON-1526735619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f080f51ac04c23a489e5dc115a1ba1',uuid=5fbfcaaa-f050-473e-9e59-e48179a606e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "address": "fa:16:3e:10:ee:9c", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff1d7189-17", "ovs_interfaceid": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Converting VIF {"id": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "address": "fa:16:3e:10:ee:9c", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff1d7189-17", "ovs_interfaceid": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:ee:9c,bridge_name='br-int',has_traffic_filtering=True,id=ff1d7189-1721-4f3b-9c25-2aa8f71d9577,network=Network(4a154aa2-0773-459f-b145-b76412506085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff1d7189-17') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.objects.instance [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lazy-loading 'pci_devices' on Instance uuid 5fbfcaaa-f050-473e-9e59-e48179a606e2 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:54:32 user nova-compute[74646]:   <uuid>5fbfcaaa-f050-473e-9e59-e48179a606e2</uuid>
Oct 26 15:54:32 user nova-compute[74646]:   <name>instance-0000000e</name>
Oct 26 15:54:32 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:54:32 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:54:32 user nova-compute[74646]:   <metadata>
Oct 26 15:54:32 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:54:32 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:54:32 user nova-compute[74646]:       <nova:name>tempest-AttachVolumeTestJSON-server-781379095</nova:name>
Oct 26 15:54:32 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:54:32</nova:creationTime>
Oct 26 15:54:32 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:54:32 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:54:32 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:54:32 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:54:32 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:54:32 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:54:32 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:54:32 user nova-compute[74646]:       <nova:owner>
Oct 26 15:54:32 user nova-compute[74646]:         <nova:user uuid="18f080f51ac04c23a489e5dc115a1ba1">tempest-AttachVolumeTestJSON-1526735619-project-member</nova:user>
Oct 26 15:54:32 user nova-compute[74646]:         <nova:project uuid="5888676639c54df88e50f01bf81d3cb8">tempest-AttachVolumeTestJSON-1526735619</nova:project>
Oct 26 15:54:32 user nova-compute[74646]:       </nova:owner>
Oct 26 15:54:32 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:54:32 user nova-compute[74646]:       <nova:ports>
Oct 26 15:54:32 user nova-compute[74646]:         <nova:port uuid="ff1d7189-1721-4f3b-9c25-2aa8f71d9577">
Oct 26 15:54:32 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 26 15:54:32 user nova-compute[74646]:         </nova:port>
Oct 26 15:54:32 user nova-compute[74646]:       </nova:ports>
Oct 26 15:54:32 user nova-compute[74646]:     </nova:instance>
Oct 26 15:54:32 user nova-compute[74646]:   </metadata>
Oct 26 15:54:32 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:54:32 user nova-compute[74646]:     <system>
Oct 26 15:54:32 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:54:32 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:54:32 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:54:32 user nova-compute[74646]:       <entry name="serial">5fbfcaaa-f050-473e-9e59-e48179a606e2</entry>
Oct 26 15:54:32 user nova-compute[74646]:       <entry name="uuid">5fbfcaaa-f050-473e-9e59-e48179a606e2</entry>
Oct 26 15:54:32 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:54:32 user nova-compute[74646]:     </system>
Oct 26 15:54:32 user nova-compute[74646]:   </sysinfo>
Oct 26 15:54:32 user nova-compute[74646]:   <os>
Oct 26 15:54:32 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:54:32 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:54:32 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:54:32 user nova-compute[74646]:   </os>
Oct 26 15:54:32 user nova-compute[74646]:   <features>
Oct 26 15:54:32 user nova-compute[74646]:     <acpi/>
Oct 26 15:54:32 user nova-compute[74646]:     <apic/>
Oct 26 15:54:32 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:54:32 user nova-compute[74646]:   </features>
Oct 26 15:54:32 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:54:32 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:54:32 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:54:32 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:54:32 user nova-compute[74646]:   </clock>
Oct 26 15:54:32 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:54:32 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:54:32 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:54:32 user nova-compute[74646]:   </cpu>
Oct 26 15:54:32 user nova-compute[74646]:   <devices>
Oct 26 15:54:32 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:54:32 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:54:32 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk"/>
Oct 26 15:54:32 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:54:32 user nova-compute[74646]:     </disk>
Oct 26 15:54:32 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:54:32 user nova-compute[74646]:       <mac address="fa:16:3e:10:ee:9c"/>
Oct 26 15:54:32 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:54:32 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:54:32 user nova-compute[74646]:       <target dev="tapff1d7189-17"/>
Oct 26 15:54:32 user nova-compute[74646]:     </interface>
Oct 26 15:54:32 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:54:32 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/console.log" append="off"/>
Oct 26 15:54:32 user nova-compute[74646]:     </serial>
Oct 26 15:54:32 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:54:32 user nova-compute[74646]:     <video>
Oct 26 15:54:32 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:54:32 user nova-compute[74646]:     </video>
Oct 26 15:54:32 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:54:32 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:54:32 user nova-compute[74646]:     </rng>
Oct 26 15:54:32 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:54:32 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:54:32 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:54:32 user nova-compute[74646]:     </memballoon>
Oct 26 15:54:32 user nova-compute[74646]:   </devices>
Oct 26 15:54:32 user nova-compute[74646]: </domain>
Oct 26 15:54:32 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:54:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-781379095',display_name='tempest-AttachVolumeTestJSON-server-781379095',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-781379095',id=14,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsXQE453uK0lLzjrYlR4DLEizoib5xh9odwhhyi+ohkUe1oujptzPPw6adTebnGGiKqHM3dtwPDy4kAxfTD8Zah+cdnpNCgYmPFZST5FAVpalPjLDvSFyjyrTpQboGUmA==',key_name='tempest-keypair-1651792393',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5888676639c54df88e50f01bf81d3cb8',ramdisk_id='',reservation_id='r-rfs5tpgc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1526735619',owner_user_name='tempest-AttachVolumeTestJSON-1526735619-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:54:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f080f51ac04c23a489e5dc115a1ba1',uuid=5fbfcaaa-f050-473e-9e59-e48179a606e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "address": "fa:16:3e:10:ee:9c", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff1d7189-17", "ovs_interfaceid": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Converting VIF {"id": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "address": "fa:16:3e:10:ee:9c", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff1d7189-17", "ovs_interfaceid": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:ee:9c,bridge_name='br-int',has_traffic_filtering=True,id=ff1d7189-1721-4f3b-9c25-2aa8f71d9577,network=Network(4a154aa2-0773-459f-b145-b76412506085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff1d7189-17') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG os_vif [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:ee:9c,bridge_name='br-int',has_traffic_filtering=True,id=ff1d7189-1721-4f3b-9c25-2aa8f71d9577,network=Network(4a154aa2-0773-459f-b145-b76412506085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff1d7189-17') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d7c5889-444b-5918-9008-3458c766f711', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff1d7189-17, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff1d7189-17, col_values=(('qos', UUID('b58bac09-1ab0-4c7b-9670-5d1230459932')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff1d7189-17, col_values=(('external_ids', {'iface-id': 'ff1d7189-1721-4f3b-9c25-2aa8f71d9577', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:ee:9c', 'vm-uuid': '5fbfcaaa-f050-473e-9e59-e48179a606e2'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:32 user nova-compute[74646]: INFO os_vif [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:ee:9c,bridge_name='br-int',has_traffic_filtering=True,id=ff1d7189-1721-4f3b-9c25-2aa8f71d9577,network=Network(4a154aa2-0773-459f-b145-b76412506085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff1d7189-17')
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] No VIF found with MAC fa:16:3e:10:ee:9c, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.network.neutron [req-27c99d11-ecda-412d-a31a-e4c2ec2acc33 req-6b0d4ebc-6e56-44d9-89a8-2914af5fe026 service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Updated VIF entry in instance network info cache for port ff1d7189-1721-4f3b-9c25-2aa8f71d9577. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG nova.network.neutron [req-27c99d11-ecda-412d-a31a-e4c2ec2acc33 req-6b0d4ebc-6e56-44d9-89a8-2914af5fe026 service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Updating instance_info_cache with network_info: [{"id": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "address": "fa:16:3e:10:ee:9c", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff1d7189-17", "ovs_interfaceid": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:54:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-27c99d11-ecda-412d-a31a-e4c2ec2acc33 req-6b0d4ebc-6e56-44d9-89a8-2914af5fe026 service nova] Releasing lock "refresh_cache-5fbfcaaa-f050-473e-9e59-e48179a606e2" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:54:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-a1d5af27-2dd4-4be7-9248-309b372cc695 req-9ea891b3-77bf-442f-a60d-89d9eafedae8 service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Received event network-vif-plugged-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a1d5af27-2dd4-4be7-9248-309b372cc695 req-9ea891b3-77bf-442f-a60d-89d9eafedae8 service nova] Acquiring lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a1d5af27-2dd4-4be7-9248-309b372cc695 req-9ea891b3-77bf-442f-a60d-89d9eafedae8 service nova] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a1d5af27-2dd4-4be7-9248-309b372cc695 req-9ea891b3-77bf-442f-a60d-89d9eafedae8 service nova] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-a1d5af27-2dd4-4be7-9248-309b372cc695 req-9ea891b3-77bf-442f-a60d-89d9eafedae8 service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] No waiting events found dispatching network-vif-plugged-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:54:33 user nova-compute[74646]: WARNING nova.compute.manager [req-a1d5af27-2dd4-4be7-9248-309b372cc695 req-9ea891b3-77bf-442f-a60d-89d9eafedae8 service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Received unexpected event network-vif-plugged-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 for instance with vm_state building and task_state spawning.
Oct 26 15:54:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:54:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:54:35 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Instance spawned successfully.
Oct 26 15:54:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:54:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:54:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:54:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:54:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:54:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:54:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:54:36 user nova-compute[74646]: DEBUG nova.compute.manager [req-d46cc28b-f8aa-4141-906b-f13b11ebd380 req-6be9b13c-67ba-4021-a6f9-bbce0cf8464e service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Received event network-vif-plugged-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d46cc28b-f8aa-4141-906b-f13b11ebd380 req-6be9b13c-67ba-4021-a6f9-bbce0cf8464e service nova] Acquiring lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d46cc28b-f8aa-4141-906b-f13b11ebd380 req-6be9b13c-67ba-4021-a6f9-bbce0cf8464e service nova] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d46cc28b-f8aa-4141-906b-f13b11ebd380 req-6be9b13c-67ba-4021-a6f9-bbce0cf8464e service nova] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:36 user nova-compute[74646]: DEBUG nova.compute.manager [req-d46cc28b-f8aa-4141-906b-f13b11ebd380 req-6be9b13c-67ba-4021-a6f9-bbce0cf8464e service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] No waiting events found dispatching network-vif-plugged-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:54:36 user nova-compute[74646]: WARNING nova.compute.manager [req-d46cc28b-f8aa-4141-906b-f13b11ebd380 req-6be9b13c-67ba-4021-a6f9-bbce0cf8464e service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Received unexpected event network-vif-plugged-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 for instance with vm_state building and task_state spawning.
Oct 26 15:54:36 user nova-compute[74646]: INFO nova.compute.manager [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Took 5.97 seconds to spawn the instance on the hypervisor.
Oct 26 15:54:36 user nova-compute[74646]: DEBUG nova.compute.manager [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:54:36 user nova-compute[74646]: INFO nova.compute.manager [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Took 6.79 seconds to build instance.
Oct 26 15:54:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-18369948-cbf5-4f9e-9bc9-2be1ef9ba4d4 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.944s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:48 user nova-compute[74646]: INFO nova.virt.block_device [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Booting with volume c85cc118-93ba-4153-abde-48c41d13909b at /dev/vdc
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.utils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0054b08-db86-48cf-966e-255ce7547b1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:54:49 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Creating image(s)
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Ensure instance console log exists: /opt/stack/data/nova/instances/ea252f48-c697-445e-bfc8-4a919b23aa83/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Start _get_guest_xml network_info=[{"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cf56ceb-7a00-44df-8241-64aa699593d0", "address": "fa:16:3e:53:50:ad", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf56ceb-7a", "ovs_interfaceid": "0cf56ceb-7a00-44df-8241-64aa699593d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "address": "fa:16:3e:a9:06:78", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28218d89-be", "ovs_interfaceid": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'dcee5015-5675-4949-983a-0c3d89638373', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yrKbVPUh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ea252f48-c697-445e-bfc8-4a919b23aa83', 'attached_at': '', 'detached_at': '', 'volume_id': '8b515835-42e3-4304-ab91-13eb78f289eb', 'serial': '8b515835-42e3-4304-ab91-13eb78f289eb'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'boot_index': 1, 'mount_device': '/dev/vdb', 'attachment_id': '2900e285-434b-417a-b51e-311d2a0ae658', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBEJXVWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ea252f48-c697-445e-bfc8-4a919b23aa83', 'attached_at': '', 'detached_at': '', 'volume_id': 'e89b4d1b-224d-4b00-b83c-1190338c8eae', 'serial': 'e89b4d1b-224d-4b00-b83c-1190338c8eae'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'boot_index': 2, 'mount_device': '/dev/vdc', 'attachment_id': '9c7a81ff-013f-425d-b1c4-d41729a65c52', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdtCcXvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ea252f48-c697-445e-bfc8-4a919b23aa83', 'attached_at': '', 'detached_at': '', 'volume_id': '67a3a413-6e2c-4467-a709-b564560091cd', 'serial': '67a3a413-6e2c-4467-a709-b564560091cd'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d1313a-819e-4f53-b709-a8f6d9cd3f4d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:54:49 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yrKbVPUh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:54:49 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:54:49 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:54:49 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a2d674-8de9-4c4c-91bd-163ce1d338da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a569085-15df-4529-80e1-51c3a2de363a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc605f7-9ec2-46fd-a939-d61b931df4ff]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:54:49 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:54:49 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3edd0b3c-9fb5-41c8-ac66-f2b25aa28c0f]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.utils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] <== get_connector_properties: return (205ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updating existing volume attachment record: 0a93e5f8-d86f-4efe-8b51-1e77b86ff081 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.137s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1975beb9-be4d-4245-ac9d-88d96a5804be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb] added
Oct 26 15:54:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfd243f-c0b4-413c-8a35-0f890107dd08]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.143s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0625bc24-d61f-4b9b-b0d2-a0606ff6eb30]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yrKbVPUh {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yrKbVPUh" returned: 0 in 0.030s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b658d2a-1f34-41fd-b9f0-24f4760861e5]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yrKbVPUh'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.052s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed0574d-91d0-453f-8ea0-9ba2648fadc0]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8272f5d-90a8-4f04-8a5f-49183cdcbd02]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 15:54:49 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 15:54:49 user nova-compute[74646]:  {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:54:49 user nova-compute[74646]: WARNING os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 15:54:49 user nova-compute[74646]: 
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b96ea5b-df14-4b5b-a827-838ddecc603d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb, portal: 172.16.0.220,3260]
Oct 26 15:54:49 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb, portal: 172.16.0.220,3260] successful.
Oct 26 15:54:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.039s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc837ce-b3e5-401d-9b65-6e3f9f1809d8]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0283bf85-17ea-416a-b1ea-6c5aee0cebad]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:54:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:54:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.677s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] HCTL ('33', '-', '-', 0) found on session 9 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b447648-44ef-48ec-9010-250fd2d0d389]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Searching for a device in session 9 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:54:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yrKbVPUh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.717s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] <== connect_volume: return (1718ms) {'type': 'block', 'scsi_wwn': '26166653333626233', 'path': '/dev/sdb'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26166653333626233', 'path': '/dev/sdb'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBEJXVWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:54:50 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:54:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:54:50 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:54:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:54:50 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:54:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa96df86-8bdc-455e-8ef7-293388350ce9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:54:50 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2931bce7-2689-434b-a882-e57faa7a03a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae] added
Oct 26 15:54:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9afce540-3631-43b3-a0ff-ef5c095a36c6]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[86498d9f-d7fb-4e08-a16c-6cf384e819a9]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBEJXVWm {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gBEJXVWm" returned: 0 in 0.037s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa22d7da-ea2f-439d-9c25-ced2a0991b85]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gBEJXVWm'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a5b88b-c8c5-44f1-8aa2-b79b004c590e]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f1ad67-620c-4da4-a237-bfd8cfa4bf4c]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:54:51 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:54:51 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9945d008-eb82-4323-9d42-50c59ca6dd1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae, portal: 172.16.0.220,3260]
Oct 26 15:54:51 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae, portal: 172.16.0.220,3260] successful.
Oct 26 15:54:51 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cbc2aa-8d8d-4f39-aff6-2c5302e6f884]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[383787a1-1f7e-49ba-97ed-ffdd3b315a99]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:54:51 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:54:51 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:54:51 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:54:51 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.362s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] HCTL ('34', '-', '-', 0) found on session 10 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb500570-31d1-4a18-ba55-541482e3612c]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Searching for a device in session 10 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:54:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBEJXVWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26134396466663862', 'path': '/dev/sdc'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134396466663862', 'path': '/dev/sdc'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdtCcXvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:54:52 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:54:52 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:54:52 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0475865d-16f0-4ed1-86d7-ecc0cb93010f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:54:52 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41cd3fc-8352-4b3c-a5f4-75e1e7f61fe6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd] added
Oct 26 15:54:52 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cadc2248-4453-4456-a849-d70ae113afd3]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[912b50dc-dafb-4192-886e-0021bffc8dc4]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdtCcXvK {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qdtCcXvK" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ece2da-05e2-4f41-b952-4d70ef463af9]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qdtCcXvK'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5560c0-486c-4276-ac69-0b8bfaabe19c]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b93dea-0a2b-4682-b270-dfe28bbfda05]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:54:52 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:54:52 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:54:52 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:54:52 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9013ad-da1a-4cf3-a596-9748c92b564f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd, portal: 172.16.0.220,3260]
Oct 26 15:54:52 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd, portal: 172.16.0.220,3260] successful.
Oct 26 15:54:52 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[62be80bd-bb89-4a94-a52f-cba27bab724f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[574a7003-17e9-4669-9906-3a70148f8fec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:54:52 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:54:52 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:54:52 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:54:52 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:54:52 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:54:52 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0683e4a1-447c-433e-aa64-f5ca5750b847]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:54:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdtCcXvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23466323863343732', 'path': '/dev/sdd'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466323863343732', 'path': '/dev/sdd'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:43:11,bridge_name='br-int',has_traffic_filtering=True,id=95eb1246-2ee9-4a59-979b-79c153fd7d8d,network=Network(3a05da1f-beab-43d8-966d-f48048823b2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95eb1246-2e') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:74:e8,bridge_name='br-int',has_traffic_filtering=True,id=15047c00-6637-4474-8e2d-a8c0fa1f0e7b,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15047c00-66') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:81:e3,bridge_name='br-int',has_traffic_filtering=True,id=84740bfb-a2c6-47dd-81f6-1b8b447349d1,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap84740bfb-a2') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cf56ceb-7a00-44df-8241-64aa699593d0", "address": "fa:16:3e:53:50:ad", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf56ceb-7a", "ovs_interfaceid": "0cf56ceb-7a00-44df-8241-64aa699593d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "0cf56ceb-7a00-44df-8241-64aa699593d0", "address": "fa:16:3e:53:50:ad", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf56ceb-7a", "ovs_interfaceid": "0cf56ceb-7a00-44df-8241-64aa699593d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:50:ad,bridge_name='br-int',has_traffic_filtering=True,id=0cf56ceb-7a00-44df-8241-64aa699593d0,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf56ceb-7a') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:fb:a2,bridge_name='br-int',has_traffic_filtering=True,id=9d77193f-b6bb-4a85-9380-d46735e5232b,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d77193f-b6') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:85:7e,bridge_name='br-int',has_traffic_filtering=True,id=cbf3c1ca-d650-4636-938c-168459a271d8,network=Network(cad5dbb8-3017-4e41-a074-277a6347f429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbf3c1ca-d6') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "address": "fa:16:3e:a9:06:78", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28218d89-be", "ovs_interfaceid": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "address": "fa:16:3e:a9:06:78", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28218d89-be", "ovs_interfaceid": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:06:78,bridge_name='br-int',has_traffic_filtering=True,id=28218d89-bed3-4eca-83fd-9fbbe8ddf7c9,network=Network(cad5dbb8-3017-4e41-a074-277a6347f429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28218d89-be') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.objects.instance [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lazy-loading 'pci_devices' on Instance uuid ea252f48-c697-445e-bfc8-4a919b23aa83 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:54:53 user nova-compute[74646]:   <uuid>ea252f48-c697-445e-bfc8-4a919b23aa83</uuid>
Oct 26 15:54:53 user nova-compute[74646]:   <name>instance-0000000b</name>
Oct 26 15:54:53 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:54:53 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:54:53 user nova-compute[74646]:   <metadata>
Oct 26 15:54:53 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:54:53 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:54:53 user nova-compute[74646]:       <nova:name>tempest-device-tagging-server-465139721</nova:name>
Oct 26 15:54:53 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:54:49</nova:creationTime>
Oct 26 15:54:53 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:54:53 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:54:53 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:54:53 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:54:53 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:54:53 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:54:53 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:54:53 user nova-compute[74646]:       <nova:owner>
Oct 26 15:54:53 user nova-compute[74646]:         <nova:user uuid="7df1f6464b92453296f2985cd77e95fe">tempest-TaggedBootDevicesTest_v242-1766906406-project-member</nova:user>
Oct 26 15:54:53 user nova-compute[74646]:         <nova:project uuid="0beca39b7190412597eb3a5b27a26a99">tempest-TaggedBootDevicesTest_v242-1766906406</nova:project>
Oct 26 15:54:53 user nova-compute[74646]:       </nova:owner>
Oct 26 15:54:53 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:54:53 user nova-compute[74646]:       <nova:ports>
Oct 26 15:54:53 user nova-compute[74646]:         <nova:port uuid="95eb1246-2ee9-4a59-979b-79c153fd7d8d">
Oct 26 15:54:53 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 15:54:53 user nova-compute[74646]:         </nova:port>
Oct 26 15:54:53 user nova-compute[74646]:         <nova:port uuid="15047c00-6637-4474-8e2d-a8c0fa1f0e7b">
Oct 26 15:54:53 user nova-compute[74646]:           <nova:ip type="fixed" address="10.1.1.64" ipVersion="4"/>
Oct 26 15:54:53 user nova-compute[74646]:         </nova:port>
Oct 26 15:54:53 user nova-compute[74646]:         <nova:port uuid="84740bfb-a2c6-47dd-81f6-1b8b447349d1">
Oct 26 15:54:53 user nova-compute[74646]:           <nova:ip type="fixed" address="10.1.1.154" ipVersion="4"/>
Oct 26 15:54:53 user nova-compute[74646]:         </nova:port>
Oct 26 15:54:53 user nova-compute[74646]:         <nova:port uuid="0cf56ceb-7a00-44df-8241-64aa699593d0">
Oct 26 15:54:53 user nova-compute[74646]:           <nova:ip type="fixed" address="10.1.1.13" ipVersion="4"/>
Oct 26 15:54:53 user nova-compute[74646]:         </nova:port>
Oct 26 15:54:53 user nova-compute[74646]:         <nova:port uuid="9d77193f-b6bb-4a85-9380-d46735e5232b">
Oct 26 15:54:53 user nova-compute[74646]:           <nova:ip type="fixed" address="10.1.1.76" ipVersion="4"/>
Oct 26 15:54:53 user nova-compute[74646]:         </nova:port>
Oct 26 15:54:53 user nova-compute[74646]:         <nova:port uuid="cbf3c1ca-d650-4636-938c-168459a271d8">
Oct 26 15:54:53 user nova-compute[74646]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 26 15:54:53 user nova-compute[74646]:         </nova:port>
Oct 26 15:54:53 user nova-compute[74646]:         <nova:port uuid="28218d89-bed3-4eca-83fd-9fbbe8ddf7c9">
Oct 26 15:54:53 user nova-compute[74646]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 26 15:54:53 user nova-compute[74646]:         </nova:port>
Oct 26 15:54:53 user nova-compute[74646]:       </nova:ports>
Oct 26 15:54:53 user nova-compute[74646]:     </nova:instance>
Oct 26 15:54:53 user nova-compute[74646]:   </metadata>
Oct 26 15:54:53 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:54:53 user nova-compute[74646]:     <system>
Oct 26 15:54:53 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:54:53 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:54:53 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:54:53 user nova-compute[74646]:       <entry name="serial">ea252f48-c697-445e-bfc8-4a919b23aa83</entry>
Oct 26 15:54:53 user nova-compute[74646]:       <entry name="uuid">ea252f48-c697-445e-bfc8-4a919b23aa83</entry>
Oct 26 15:54:53 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:54:53 user nova-compute[74646]:     </system>
Oct 26 15:54:53 user nova-compute[74646]:   </sysinfo>
Oct 26 15:54:53 user nova-compute[74646]:   <os>
Oct 26 15:54:53 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:54:53 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:54:53 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:54:53 user nova-compute[74646]:   </os>
Oct 26 15:54:53 user nova-compute[74646]:   <features>
Oct 26 15:54:53 user nova-compute[74646]:     <acpi/>
Oct 26 15:54:53 user nova-compute[74646]:     <apic/>
Oct 26 15:54:53 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:54:53 user nova-compute[74646]:   </features>
Oct 26 15:54:53 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:54:53 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:54:53 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:54:53 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:54:53 user nova-compute[74646]:   </clock>
Oct 26 15:54:53 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:54:53 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:54:53 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:54:53 user nova-compute[74646]:   </cpu>
Oct 26 15:54:53 user nova-compute[74646]:   <devices>
Oct 26 15:54:53 user nova-compute[74646]:     <disk type="file" device="cdrom">
Oct 26 15:54:53 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 15:54:53 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/ea252f48-c697-445e-bfc8-4a919b23aa83/disk.config"/>
Oct 26 15:54:53 user nova-compute[74646]:       <target dev="hda" bus="ide"/>
Oct 26 15:54:53 user nova-compute[74646]:     </disk>
Oct 26 15:54:53 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 15:54:53 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:54:53 user nova-compute[74646]:       <source dev="/dev/sdb"/>
Oct 26 15:54:53 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:54:53 user nova-compute[74646]:       <serial>8b515835-42e3-4304-ab91-13eb78f289eb</serial>
Oct 26 15:54:53 user nova-compute[74646]:     </disk>
Oct 26 15:54:53 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 15:54:53 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:54:53 user nova-compute[74646]:       <source dev="/dev/sdc"/>
Oct 26 15:54:53 user nova-compute[74646]:       <target dev="vdb" bus="virtio"/>
Oct 26 15:54:53 user nova-compute[74646]:       <serial>e89b4d1b-224d-4b00-b83c-1190338c8eae</serial>
Oct 26 15:54:53 user nova-compute[74646]:     </disk>
Oct 26 15:54:53 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 15:54:53 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:54:53 user nova-compute[74646]:       <source dev="/dev/sdd"/>
Oct 26 15:54:53 user nova-compute[74646]:       <target dev="vdc" bus="virtio"/>
Oct 26 15:54:53 user nova-compute[74646]:       <serial>67a3a413-6e2c-4467-a709-b564560091cd</serial>
Oct 26 15:54:53 user nova-compute[74646]:     </disk>
Oct 26 15:54:53 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:54:53 user nova-compute[74646]:       <mac address="fa:16:3e:30:43:11"/>
Oct 26 15:54:53 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:54:53 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:54:53 user nova-compute[74646]:       <target dev="tap95eb1246-2e"/>
Oct 26 15:54:53 user nova-compute[74646]:     </interface>
Oct 26 15:54:53 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:54:53 user nova-compute[74646]:       <mac address="fa:16:3e:3d:74:e8"/>
Oct 26 15:54:53 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:54:53 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:54:53 user nova-compute[74646]:       <target dev="tap15047c00-66"/>
Oct 26 15:54:53 user nova-compute[74646]:     </interface>
Oct 26 15:54:53 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:54:53 user nova-compute[74646]:       <mac address="fa:16:3e:34:81:e3"/>
Oct 26 15:54:53 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:54:53 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:54:53 user nova-compute[74646]:       <target dev="tap84740bfb-a2"/>
Oct 26 15:54:53 user nova-compute[74646]:     </interface>
Oct 26 15:54:53 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:54:53 user nova-compute[74646]:       <mac address="fa:16:3e:53:50:ad"/>
Oct 26 15:54:53 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:54:53 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:54:53 user nova-compute[74646]:       <target dev="tap0cf56ceb-7a"/>
Oct 26 15:54:53 user nova-compute[74646]:     </interface>
Oct 26 15:54:53 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:54:53 user nova-compute[74646]:       <mac address="fa:16:3e:23:fb:a2"/>
Oct 26 15:54:53 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:54:53 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:54:53 user nova-compute[74646]:       <target dev="tap9d77193f-b6"/>
Oct 26 15:54:53 user nova-compute[74646]:     </interface>
Oct 26 15:54:53 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:54:53 user nova-compute[74646]:       <mac address="fa:16:3e:e9:85:7e"/>
Oct 26 15:54:53 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:54:53 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:54:53 user nova-compute[74646]:       <target dev="tapcbf3c1ca-d6"/>
Oct 26 15:54:53 user nova-compute[74646]:     </interface>
Oct 26 15:54:53 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:54:53 user nova-compute[74646]:       <mac address="fa:16:3e:a9:06:78"/>
Oct 26 15:54:53 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:54:53 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:54:53 user nova-compute[74646]:       <target dev="tap28218d89-be"/>
Oct 26 15:54:53 user nova-compute[74646]:     </interface>
Oct 26 15:54:53 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:54:53 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/ea252f48-c697-445e-bfc8-4a919b23aa83/console.log" append="off"/>
Oct 26 15:54:53 user nova-compute[74646]:     </serial>
Oct 26 15:54:53 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:54:53 user nova-compute[74646]:     <video>
Oct 26 15:54:53 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:54:53 user nova-compute[74646]:     </video>
Oct 26 15:54:53 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:54:53 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:54:53 user nova-compute[74646]:     </rng>
Oct 26 15:54:53 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:54:53 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:54:53 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:54:53 user nova-compute[74646]:     </memballoon>
Oct 26 15:54:53 user nova-compute[74646]:   </devices>
Oct 26 15:54:53 user nova-compute[74646]: </domain>
Oct 26 15:54:53 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:43:11,bridge_name='br-int',has_traffic_filtering=True,id=95eb1246-2ee9-4a59-979b-79c153fd7d8d,network=Network(3a05da1f-beab-43d8-966d-f48048823b2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95eb1246-2e') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG os_vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:43:11,bridge_name='br-int',has_traffic_filtering=True,id=95eb1246-2ee9-4a59-979b-79c153fd7d8d,network=Network(3a05da1f-beab-43d8-966d-f48048823b2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95eb1246-2e') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a1d7286-8879-506d-a39d-5dcec6a363e0', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95eb1246-2e, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95eb1246-2e, col_values=(('qos', UUID('f00401a3-2fb2-42a5-8be4-67e94e86370a')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95eb1246-2e, col_values=(('external_ids', {'iface-id': '95eb1246-2ee9-4a59-979b-79c153fd7d8d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:43:11', 'vm-uuid': 'ea252f48-c697-445e-bfc8-4a919b23aa83'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: INFO os_vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:43:11,bridge_name='br-int',has_traffic_filtering=True,id=95eb1246-2ee9-4a59-979b-79c153fd7d8d,network=Network(3a05da1f-beab-43d8-966d-f48048823b2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95eb1246-2e')
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:74:e8,bridge_name='br-int',has_traffic_filtering=True,id=15047c00-6637-4474-8e2d-a8c0fa1f0e7b,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15047c00-66') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG os_vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:74:e8,bridge_name='br-int',has_traffic_filtering=True,id=15047c00-6637-4474-8e2d-a8c0fa1f0e7b,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15047c00-66') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd019eeb8-771e-55dc-9ab5-7412be2dcbbf', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap15047c00-66, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap15047c00-66, col_values=(('qos', UUID('374ed3d3-3931-407c-91f6-46941f0f8ab9')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap15047c00-66, col_values=(('external_ids', {'iface-id': '15047c00-6637-4474-8e2d-a8c0fa1f0e7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:74:e8', 'vm-uuid': 'ea252f48-c697-445e-bfc8-4a919b23aa83'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: INFO os_vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:74:e8,bridge_name='br-int',has_traffic_filtering=True,id=15047c00-6637-4474-8e2d-a8c0fa1f0e7b,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15047c00-66')
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:81:e3,bridge_name='br-int',has_traffic_filtering=True,id=84740bfb-a2c6-47dd-81f6-1b8b447349d1,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap84740bfb-a2') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG os_vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:81:e3,bridge_name='br-int',has_traffic_filtering=True,id=84740bfb-a2c6-47dd-81f6-1b8b447349d1,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap84740bfb-a2') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '847f7835-ea91-5b75-a0fe-006e806f0b14', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84740bfb-a2, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84740bfb-a2, col_values=(('qos', UUID('7d68cfcb-1a52-4f6a-bbd5-b69cf783bd24')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84740bfb-a2, col_values=(('external_ids', {'iface-id': '84740bfb-a2c6-47dd-81f6-1b8b447349d1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:34:81:e3', 'vm-uuid': 'ea252f48-c697-445e-bfc8-4a919b23aa83'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: INFO os_vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:81:e3,bridge_name='br-int',has_traffic_filtering=True,id=84740bfb-a2c6-47dd-81f6-1b8b447349d1,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap84740bfb-a2')
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cf56ceb-7a00-44df-8241-64aa699593d0", "address": "fa:16:3e:53:50:ad", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf56ceb-7a", "ovs_interfaceid": "0cf56ceb-7a00-44df-8241-64aa699593d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "0cf56ceb-7a00-44df-8241-64aa699593d0", "address": "fa:16:3e:53:50:ad", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf56ceb-7a", "ovs_interfaceid": "0cf56ceb-7a00-44df-8241-64aa699593d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:50:ad,bridge_name='br-int',has_traffic_filtering=True,id=0cf56ceb-7a00-44df-8241-64aa699593d0,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf56ceb-7a') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG os_vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:50:ad,bridge_name='br-int',has_traffic_filtering=True,id=0cf56ceb-7a00-44df-8241-64aa699593d0,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf56ceb-7a') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4d79a53-47c5-56cb-a707-54337f2a6035', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cf56ceb-7a, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0cf56ceb-7a, col_values=(('qos', UUID('8ffe8e83-3c1f-41aa-b164-43c835161e36')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0cf56ceb-7a, col_values=(('external_ids', {'iface-id': '0cf56ceb-7a00-44df-8241-64aa699593d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:50:ad', 'vm-uuid': 'ea252f48-c697-445e-bfc8-4a919b23aa83'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: INFO os_vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:50:ad,bridge_name='br-int',has_traffic_filtering=True,id=0cf56ceb-7a00-44df-8241-64aa699593d0,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf56ceb-7a')
Oct 26 15:54:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:fb:a2,bridge_name='br-int',has_traffic_filtering=True,id=9d77193f-b6bb-4a85-9380-d46735e5232b,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d77193f-b6') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG os_vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:fb:a2,bridge_name='br-int',has_traffic_filtering=True,id=9d77193f-b6bb-4a85-9380-d46735e5232b,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d77193f-b6') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d906713-3ee9-5787-b658-22b6f9078eec', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9d77193f-b6, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9d77193f-b6, col_values=(('qos', UUID('d42fc32b-2c80-4783-b16e-74d6269993d1')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9d77193f-b6, col_values=(('external_ids', {'iface-id': '9d77193f-b6bb-4a85-9380-d46735e5232b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:fb:a2', 'vm-uuid': 'ea252f48-c697-445e-bfc8-4a919b23aa83'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: INFO os_vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:fb:a2,bridge_name='br-int',has_traffic_filtering=True,id=9d77193f-b6bb-4a85-9380-d46735e5232b,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d77193f-b6')
Oct 26 15:54:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:85:7e,bridge_name='br-int',has_traffic_filtering=True,id=cbf3c1ca-d650-4636-938c-168459a271d8,network=Network(cad5dbb8-3017-4e41-a074-277a6347f429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbf3c1ca-d6') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG os_vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:85:7e,bridge_name='br-int',has_traffic_filtering=True,id=cbf3c1ca-d650-4636-938c-168459a271d8,network=Network(cad5dbb8-3017-4e41-a074-277a6347f429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbf3c1ca-d6') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4397db57-72c7-50ee-b158-918a7dfb91ac', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbf3c1ca-d6, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapcbf3c1ca-d6, col_values=(('qos', UUID('2f9e32fa-0a56-4d34-baf7-109dbbae5e31')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapcbf3c1ca-d6, col_values=(('external_ids', {'iface-id': 'cbf3c1ca-d650-4636-938c-168459a271d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:85:7e', 'vm-uuid': 'ea252f48-c697-445e-bfc8-4a919b23aa83'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: INFO os_vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:85:7e,bridge_name='br-int',has_traffic_filtering=True,id=cbf3c1ca-d650-4636-938c-168459a271d8,network=Network(cad5dbb8-3017-4e41-a074-277a6347f429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbf3c1ca-d6')
Oct 26 15:54:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "address": "fa:16:3e:a9:06:78", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28218d89-be", "ovs_interfaceid": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "address": "fa:16:3e:a9:06:78", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28218d89-be", "ovs_interfaceid": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:06:78,bridge_name='br-int',has_traffic_filtering=True,id=28218d89-bed3-4eca-83fd-9fbbe8ddf7c9,network=Network(cad5dbb8-3017-4e41-a074-277a6347f429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28218d89-be') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG os_vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:06:78,bridge_name='br-int',has_traffic_filtering=True,id=28218d89-bed3-4eca-83fd-9fbbe8ddf7c9,network=Network(cad5dbb8-3017-4e41-a074-277a6347f429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28218d89-be') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c6692c89-50d2-56ff-b6ce-417ccc6b5dc0', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28218d89-be, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap28218d89-be, col_values=(('qos', UUID('27bd7466-1329-444b-a6c7-3e178b097ebe')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap28218d89-be, col_values=(('external_ids', {'iface-id': '28218d89-bed3-4eca-83fd-9fbbe8ddf7c9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a9:06:78', 'vm-uuid': 'ea252f48-c697-445e-bfc8-4a919b23aa83'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:54 user nova-compute[74646]: INFO os_vif [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:06:78,bridge_name='br-int',has_traffic_filtering=True,id=28218d89-bed3-4eca-83fd-9fbbe8ddf7c9,network=Network(cad5dbb8-3017-4e41-a074-277a6347f429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28218d89-be')
Oct 26 15:54:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] No BDM found with device name hda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] No VIF found with MAC fa:16:3e:30:43:11, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:54:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] No VIF found with MAC fa:16:3e:23:fb:a2, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:54:54 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Using config drive
Oct 26 15:54:55 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Creating config drive at /opt/stack/data/nova/instances/ea252f48-c697-445e-bfc8-4a919b23aa83/disk.config
Oct 26 15:54:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ea252f48-c697-445e-bfc8-4a919b23aa83/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_kqb2pkc {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:54:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ea252f48-c697-445e-bfc8-4a919b23aa83/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp_kqb2pkc" returned: 0 in 0.087s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:54:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-5874d6f6-e2fb-4e40-a78f-568b368160b4 req-7f0435cb-616c-4dc4-b32e-e9d0201112bd service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5874d6f6-e2fb-4e40-a78f-568b368160b4 req-7f0435cb-616c-4dc4-b32e-e9d0201112bd service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5874d6f6-e2fb-4e40-a78f-568b368160b4 req-7f0435cb-616c-4dc4-b32e-e9d0201112bd service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5874d6f6-e2fb-4e40-a78f-568b368160b4 req-7f0435cb-616c-4dc4-b32e-e9d0201112bd service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-5874d6f6-e2fb-4e40-a78f-568b368160b4 req-7f0435cb-616c-4dc4-b32e-e9d0201112bd service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:54:57 user nova-compute[74646]: WARNING nova.compute.manager [req-5874d6f6-e2fb-4e40-a78f-568b368160b4 req-7f0435cb-616c-4dc4-b32e-e9d0201112bd service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-95eb1246-2ee9-4a59-979b-79c153fd7d8d for instance with vm_state building and task_state spawning.
Oct 26 15:54:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-24b464e0-50a2-402e-a0ae-1e5a55bb634d req-f9fac3d3-5093-4048-8c7f-1f7770713c8c service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-15047c00-6637-4474-8e2d-a8c0fa1f0e7b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-24b464e0-50a2-402e-a0ae-1e5a55bb634d req-f9fac3d3-5093-4048-8c7f-1f7770713c8c service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-24b464e0-50a2-402e-a0ae-1e5a55bb634d req-f9fac3d3-5093-4048-8c7f-1f7770713c8c service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-24b464e0-50a2-402e-a0ae-1e5a55bb634d req-f9fac3d3-5093-4048-8c7f-1f7770713c8c service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-24b464e0-50a2-402e-a0ae-1e5a55bb634d req-f9fac3d3-5093-4048-8c7f-1f7770713c8c service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-15047c00-6637-4474-8e2d-a8c0fa1f0e7b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:54:57 user nova-compute[74646]: WARNING nova.compute.manager [req-24b464e0-50a2-402e-a0ae-1e5a55bb634d req-f9fac3d3-5093-4048-8c7f-1f7770713c8c service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-15047c00-6637-4474-8e2d-a8c0fa1f0e7b for instance with vm_state building and task_state spawning.
Oct 26 15:54:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:54:59 user nova-compute[74646]: WARNING nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-95eb1246-2ee9-4a59-979b-79c153fd7d8d for instance with vm_state building and task_state spawning.
Oct 26 15:54:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-84740bfb-a2c6-47dd-81f6-1b8b447349d1 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-84740bfb-a2c6-47dd-81f6-1b8b447349d1 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:54:59 user nova-compute[74646]: WARNING nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-84740bfb-a2c6-47dd-81f6-1b8b447349d1 for instance with vm_state building and task_state spawning.
Oct 26 15:54:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-84740bfb-a2c6-47dd-81f6-1b8b447349d1 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-84740bfb-a2c6-47dd-81f6-1b8b447349d1 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:54:59 user nova-compute[74646]: WARNING nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-84740bfb-a2c6-47dd-81f6-1b8b447349d1 for instance with vm_state building and task_state spawning.
Oct 26 15:54:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-0cf56ceb-7a00-44df-8241-64aa699593d0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-0cf56ceb-7a00-44df-8241-64aa699593d0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:54:59 user nova-compute[74646]: WARNING nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-0cf56ceb-7a00-44df-8241-64aa699593d0 for instance with vm_state building and task_state spawning.
Oct 26 15:54:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-0cf56ceb-7a00-44df-8241-64aa699593d0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-0cf56ceb-7a00-44df-8241-64aa699593d0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:54:59 user nova-compute[74646]: WARNING nova.compute.manager [req-1f702358-0199-42ea-9339-a6343314fd5c req-178f9230-70e3-4415-8c4d-5a11059e9dc9 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-0cf56ceb-7a00-44df-8241-64aa699593d0 for instance with vm_state building and task_state spawning.
Oct 26 15:54:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-0d6bd080-b312-4cb9-a140-b4cbf4a3c276 req-018a2ca3-86cd-4be8-8184-327c19c51206 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-15047c00-6637-4474-8e2d-a8c0fa1f0e7b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0d6bd080-b312-4cb9-a140-b4cbf4a3c276 req-018a2ca3-86cd-4be8-8184-327c19c51206 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0d6bd080-b312-4cb9-a140-b4cbf4a3c276 req-018a2ca3-86cd-4be8-8184-327c19c51206 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0d6bd080-b312-4cb9-a140-b4cbf4a3c276 req-018a2ca3-86cd-4be8-8184-327c19c51206 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-0d6bd080-b312-4cb9-a140-b4cbf4a3c276 req-018a2ca3-86cd-4be8-8184-327c19c51206 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-15047c00-6637-4474-8e2d-a8c0fa1f0e7b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:54:59 user nova-compute[74646]: WARNING nova.compute.manager [req-0d6bd080-b312-4cb9-a140-b4cbf4a3c276 req-018a2ca3-86cd-4be8-8184-327c19c51206 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-15047c00-6637-4474-8e2d-a8c0fa1f0e7b for instance with vm_state building and task_state spawning.
Oct 26 15:54:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:54:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-9d77193f-b6bb-4a85-9380-d46735e5232b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-9d77193f-b6bb-4a85-9380-d46735e5232b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:01 user nova-compute[74646]: WARNING nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-9d77193f-b6bb-4a85-9380-d46735e5232b for instance with vm_state building and task_state spawning.
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-9d77193f-b6bb-4a85-9380-d46735e5232b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-9d77193f-b6bb-4a85-9380-d46735e5232b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:01 user nova-compute[74646]: WARNING nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-9d77193f-b6bb-4a85-9380-d46735e5232b for instance with vm_state building and task_state spawning.
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-cbf3c1ca-d650-4636-938c-168459a271d8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-cbf3c1ca-d650-4636-938c-168459a271d8 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:01 user nova-compute[74646]: WARNING nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-cbf3c1ca-d650-4636-938c-168459a271d8 for instance with vm_state building and task_state spawning.
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-cbf3c1ca-d650-4636-938c-168459a271d8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-cbf3c1ca-d650-4636-938c-168459a271d8 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:01 user nova-compute[74646]: WARNING nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-cbf3c1ca-d650-4636-938c-168459a271d8 for instance with vm_state building and task_state spawning.
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:01 user nova-compute[74646]: WARNING nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 for instance with vm_state building and task_state spawning.
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:01 user nova-compute[74646]: WARNING nova.compute.manager [req-6dead0e1-7d46-452f-b223-ef1d5cef2a26 req-8359ff8b-cfb7-4263-a8f8-f52f6e214901 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 for instance with vm_state building and task_state spawning.
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:55:01 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Instance spawned successfully.
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:01 user nova-compute[74646]: INFO nova.compute.manager [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Took 12.82 seconds to spawn the instance on the hypervisor.
Oct 26 15:55:01 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:55:01 user nova-compute[74646]: INFO nova.compute.manager [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Took 188.09 seconds to build instance.
Oct 26 15:55:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ed62799d-7bf1-4e6a-89a5-0a363512075b tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 188.209s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "2b514455-44b2-4115-bb13-38ba1713a263" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "2b514455-44b2-4115-bb13-38ba1713a263" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:08 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:55:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:08 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:55:08 user nova-compute[74646]: INFO nova.compute.claims [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Claim successful on node user
Oct 26 15:55:09 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:55:09 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:55:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG nova.policy [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05a35d09461745e1a1250ecdc2443a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1515df0bbff42d5be9f8ba40cdeb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:55:09 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Creating image(s)
Oct 26 15:55:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "/opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "/opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "/opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.242s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.200s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk 1073741824" returned: 0 in 0.062s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.218s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Successfully created port: db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Cannot resize image /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Ensure instance console log exists: /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:10 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Successfully updated port: db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "refresh_cache-2b514455-44b2-4115-bb13-38ba1713a263" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquired lock "refresh_cache-2b514455-44b2-4115-bb13-38ba1713a263" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.compute.manager [req-5dbc112d-209e-457c-b2c5-860b6f5aa85c req-21d9210c-c1fd-41a4-bbfd-e290d81f7fe1 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Received event network-changed-db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.compute.manager [req-5dbc112d-209e-457c-b2c5-860b6f5aa85c req-21d9210c-c1fd-41a4-bbfd-e290d81f7fe1 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Refreshing instance network info cache due to event network-changed-db3b9afe-9410-40a7-981e-cb59201a81b2. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5dbc112d-209e-457c-b2c5-860b6f5aa85c req-21d9210c-c1fd-41a4-bbfd-e290d81f7fe1 service nova] Acquiring lock "refresh_cache-2b514455-44b2-4115-bb13-38ba1713a263" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Updating instance_info_cache with network_info: [{"id": "db3b9afe-9410-40a7-981e-cb59201a81b2", "address": "fa:16:3e:4a:fd:67", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3b9afe-94", "ovs_interfaceid": "db3b9afe-9410-40a7-981e-cb59201a81b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Releasing lock "refresh_cache-2b514455-44b2-4115-bb13-38ba1713a263" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Instance network_info: |[{"id": "db3b9afe-9410-40a7-981e-cb59201a81b2", "address": "fa:16:3e:4a:fd:67", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3b9afe-94", "ovs_interfaceid": "db3b9afe-9410-40a7-981e-cb59201a81b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5dbc112d-209e-457c-b2c5-860b6f5aa85c req-21d9210c-c1fd-41a4-bbfd-e290d81f7fe1 service nova] Acquired lock "refresh_cache-2b514455-44b2-4115-bb13-38ba1713a263" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.network.neutron [req-5dbc112d-209e-457c-b2c5-860b6f5aa85c req-21d9210c-c1fd-41a4-bbfd-e290d81f7fe1 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Refreshing network info cache for port db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Start _get_guest_xml network_info=[{"id": "db3b9afe-9410-40a7-981e-cb59201a81b2", "address": "fa:16:3e:4a:fd:67", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3b9afe-94", "ovs_interfaceid": "db3b9afe-9410-40a7-981e-cb59201a81b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:55:11 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:55:11 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1989406713',display_name='tempest-VolumesAdminNegativeTest-server-1989406713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1989406713',id=15,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFht9hnSgYylRDeMSywvMgAV5i27sF0PdpixMYVqQGizFbY0kIUpKCBfVJ/RzOpqltF8r/N/DHFo5YIJuQbdba2FOqVCOmOpuWK6Jv0wQeYDYLNe2LRP4KatXjPPHbOM8A==',key_name='tempest-keypair-2021206852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1515df0bbff42d5be9f8ba40cdeb0da',ramdisk_id='',reservation_id='r-k0iykmln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-464290099',owner_user_name='tempest-VolumesAdminNegativeTest-464290099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:55:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a35d09461745e1a1250ecdc2443a75',uuid=2b514455-44b2-4115-bb13-38ba1713a263,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db3b9afe-9410-40a7-981e-cb59201a81b2", "address": "fa:16:3e:4a:fd:67", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3b9afe-94", "ovs_interfaceid": "db3b9afe-9410-40a7-981e-cb59201a81b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Converting VIF {"id": "db3b9afe-9410-40a7-981e-cb59201a81b2", "address": "fa:16:3e:4a:fd:67", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3b9afe-94", "ovs_interfaceid": "db3b9afe-9410-40a7-981e-cb59201a81b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:fd:67,bridge_name='br-int',has_traffic_filtering=True,id=db3b9afe-9410-40a7-981e-cb59201a81b2,network=Network(a23d40dd-77c0-4375-b256-1c5a6caa93ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb3b9afe-94') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.objects.instance [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lazy-loading 'pci_devices' on Instance uuid 2b514455-44b2-4115-bb13-38ba1713a263 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:55:11 user nova-compute[74646]:   <uuid>2b514455-44b2-4115-bb13-38ba1713a263</uuid>
Oct 26 15:55:11 user nova-compute[74646]:   <name>instance-0000000f</name>
Oct 26 15:55:11 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:55:11 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:55:11 user nova-compute[74646]:   <metadata>
Oct 26 15:55:11 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:55:11 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:55:11 user nova-compute[74646]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1989406713</nova:name>
Oct 26 15:55:11 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:55:11</nova:creationTime>
Oct 26 15:55:11 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:55:11 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:55:11 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:55:11 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:55:11 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:55:11 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:55:11 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:55:11 user nova-compute[74646]:       <nova:owner>
Oct 26 15:55:11 user nova-compute[74646]:         <nova:user uuid="05a35d09461745e1a1250ecdc2443a75">tempest-VolumesAdminNegativeTest-464290099-project-member</nova:user>
Oct 26 15:55:11 user nova-compute[74646]:         <nova:project uuid="e1515df0bbff42d5be9f8ba40cdeb0da">tempest-VolumesAdminNegativeTest-464290099</nova:project>
Oct 26 15:55:11 user nova-compute[74646]:       </nova:owner>
Oct 26 15:55:11 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:55:11 user nova-compute[74646]:       <nova:ports>
Oct 26 15:55:11 user nova-compute[74646]:         <nova:port uuid="db3b9afe-9410-40a7-981e-cb59201a81b2">
Oct 26 15:55:11 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 15:55:11 user nova-compute[74646]:         </nova:port>
Oct 26 15:55:11 user nova-compute[74646]:       </nova:ports>
Oct 26 15:55:11 user nova-compute[74646]:     </nova:instance>
Oct 26 15:55:11 user nova-compute[74646]:   </metadata>
Oct 26 15:55:11 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:55:11 user nova-compute[74646]:     <system>
Oct 26 15:55:11 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:55:11 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:55:11 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:55:11 user nova-compute[74646]:       <entry name="serial">2b514455-44b2-4115-bb13-38ba1713a263</entry>
Oct 26 15:55:11 user nova-compute[74646]:       <entry name="uuid">2b514455-44b2-4115-bb13-38ba1713a263</entry>
Oct 26 15:55:11 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:55:11 user nova-compute[74646]:     </system>
Oct 26 15:55:11 user nova-compute[74646]:   </sysinfo>
Oct 26 15:55:11 user nova-compute[74646]:   <os>
Oct 26 15:55:11 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:55:11 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:55:11 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:55:11 user nova-compute[74646]:   </os>
Oct 26 15:55:11 user nova-compute[74646]:   <features>
Oct 26 15:55:11 user nova-compute[74646]:     <acpi/>
Oct 26 15:55:11 user nova-compute[74646]:     <apic/>
Oct 26 15:55:11 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:55:11 user nova-compute[74646]:   </features>
Oct 26 15:55:11 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:55:11 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:55:11 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:55:11 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:55:11 user nova-compute[74646]:   </clock>
Oct 26 15:55:11 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:55:11 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:55:11 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:55:11 user nova-compute[74646]:   </cpu>
Oct 26 15:55:11 user nova-compute[74646]:   <devices>
Oct 26 15:55:11 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:55:11 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:55:11 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk"/>
Oct 26 15:55:11 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:55:11 user nova-compute[74646]:     </disk>
Oct 26 15:55:11 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:55:11 user nova-compute[74646]:       <mac address="fa:16:3e:4a:fd:67"/>
Oct 26 15:55:11 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:55:11 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:55:11 user nova-compute[74646]:       <target dev="tapdb3b9afe-94"/>
Oct 26 15:55:11 user nova-compute[74646]:     </interface>
Oct 26 15:55:11 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:55:11 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/console.log" append="off"/>
Oct 26 15:55:11 user nova-compute[74646]:     </serial>
Oct 26 15:55:11 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:55:11 user nova-compute[74646]:     <video>
Oct 26 15:55:11 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:55:11 user nova-compute[74646]:     </video>
Oct 26 15:55:11 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:55:11 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:55:11 user nova-compute[74646]:     </rng>
Oct 26 15:55:11 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:55:11 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:55:11 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:55:11 user nova-compute[74646]:     </memballoon>
Oct 26 15:55:11 user nova-compute[74646]:   </devices>
Oct 26 15:55:11 user nova-compute[74646]: </domain>
Oct 26 15:55:11 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1989406713',display_name='tempest-VolumesAdminNegativeTest-server-1989406713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1989406713',id=15,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFht9hnSgYylRDeMSywvMgAV5i27sF0PdpixMYVqQGizFbY0kIUpKCBfVJ/RzOpqltF8r/N/DHFo5YIJuQbdba2FOqVCOmOpuWK6Jv0wQeYDYLNe2LRP4KatXjPPHbOM8A==',key_name='tempest-keypair-2021206852',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1515df0bbff42d5be9f8ba40cdeb0da',ramdisk_id='',reservation_id='r-k0iykmln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-464290099',owner_user_name='tempest-VolumesAdminNegativeTest-464290099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:55:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a35d09461745e1a1250ecdc2443a75',uuid=2b514455-44b2-4115-bb13-38ba1713a263,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db3b9afe-9410-40a7-981e-cb59201a81b2", "address": "fa:16:3e:4a:fd:67", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3b9afe-94", "ovs_interfaceid": "db3b9afe-9410-40a7-981e-cb59201a81b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Converting VIF {"id": "db3b9afe-9410-40a7-981e-cb59201a81b2", "address": "fa:16:3e:4a:fd:67", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3b9afe-94", "ovs_interfaceid": "db3b9afe-9410-40a7-981e-cb59201a81b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:fd:67,bridge_name='br-int',has_traffic_filtering=True,id=db3b9afe-9410-40a7-981e-cb59201a81b2,network=Network(a23d40dd-77c0-4375-b256-1c5a6caa93ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb3b9afe-94') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG os_vif [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:fd:67,bridge_name='br-int',has_traffic_filtering=True,id=db3b9afe-9410-40a7-981e-cb59201a81b2,network=Network(a23d40dd-77c0-4375-b256-1c5a6caa93ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb3b9afe-94') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc747dc1-c5d0-5a03-9fc0-2c7815940d3e', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb3b9afe-94, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb3b9afe-94, col_values=(('qos', UUID('ba7cad59-833c-48ef-b146-e0148485a302')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb3b9afe-94, col_values=(('external_ids', {'iface-id': 'db3b9afe-9410-40a7-981e-cb59201a81b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:fd:67', 'vm-uuid': '2b514455-44b2-4115-bb13-38ba1713a263'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_power_states {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:11 user nova-compute[74646]: INFO os_vif [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:fd:67,bridge_name='br-int',has_traffic_filtering=True,id=db3b9afe-9410-40a7-981e-cb59201a81b2,network=Network(a23d40dd-77c0-4375-b256-1c5a6caa93ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb3b9afe-94')
Oct 26 15:55:11 user nova-compute[74646]: WARNING nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 1c5d5313-72f0-4f49-83b7-f277d5da4191 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid ea252f48-c697-445e-bfc8-4a919b23aa83 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 8e30a4ad-5c27-4f92-8f1e-4ed081198588 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 5fbfcaaa-f050-473e-9e59-e48179a606e2 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 2b514455-44b2-4115-bb13-38ba1713a263 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "1c5d5313-72f0-4f49-83b7-f277d5da4191" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "2b514455-44b2-4115-bb13-38ba1713a263" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.102s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] No VIF found with MAC fa:16:3e:4a:fd:67, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.138s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.network.neutron [req-5dbc112d-209e-457c-b2c5-860b6f5aa85c req-21d9210c-c1fd-41a4-bbfd-e290d81f7fe1 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Updated VIF entry in instance network info cache for port db3b9afe-9410-40a7-981e-cb59201a81b2. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG nova.network.neutron [req-5dbc112d-209e-457c-b2c5-860b6f5aa85c req-21d9210c-c1fd-41a4-bbfd-e290d81f7fe1 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Updating instance_info_cache with network_info: [{"id": "db3b9afe-9410-40a7-981e-cb59201a81b2", "address": "fa:16:3e:4a:fd:67", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3b9afe-94", "ovs_interfaceid": "db3b9afe-9410-40a7-981e-cb59201a81b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:55:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5dbc112d-209e-457c-b2c5-860b6f5aa85c req-21d9210c-c1fd-41a4-bbfd-e290d81f7fe1 service nova] Releasing lock "refresh_cache-2b514455-44b2-4115-bb13-38ba1713a263" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:55:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:13 user nova-compute[74646]: DEBUG nova.compute.manager [req-6d00df09-41de-4dd2-8b69-ff2343b011da req-95bb0f29-9568-4017-9335-f91860b9de6e service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Received event network-vif-plugged-db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6d00df09-41de-4dd2-8b69-ff2343b011da req-95bb0f29-9568-4017-9335-f91860b9de6e service nova] Acquiring lock "2b514455-44b2-4115-bb13-38ba1713a263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6d00df09-41de-4dd2-8b69-ff2343b011da req-95bb0f29-9568-4017-9335-f91860b9de6e service nova] Lock "2b514455-44b2-4115-bb13-38ba1713a263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6d00df09-41de-4dd2-8b69-ff2343b011da req-95bb0f29-9568-4017-9335-f91860b9de6e service nova] Lock "2b514455-44b2-4115-bb13-38ba1713a263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:13 user nova-compute[74646]: DEBUG nova.compute.manager [req-6d00df09-41de-4dd2-8b69-ff2343b011da req-95bb0f29-9568-4017-9335-f91860b9de6e service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] No waiting events found dispatching network-vif-plugged-db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:13 user nova-compute[74646]: WARNING nova.compute.manager [req-6d00df09-41de-4dd2-8b69-ff2343b011da req-95bb0f29-9568-4017-9335-f91860b9de6e service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Received unexpected event network-vif-plugged-db3b9afe-9410-40a7-981e-cb59201a81b2 for instance with vm_state building and task_state spawning.
Oct 26 15:55:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-8197ad06-980a-42fd-a79a-417aee8205cf req-87ef3e43-724d-4cf2-886b-ae6e3b275fc3 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Received event network-vif-plugged-db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8197ad06-980a-42fd-a79a-417aee8205cf req-87ef3e43-724d-4cf2-886b-ae6e3b275fc3 service nova] Acquiring lock "2b514455-44b2-4115-bb13-38ba1713a263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8197ad06-980a-42fd-a79a-417aee8205cf req-87ef3e43-724d-4cf2-886b-ae6e3b275fc3 service nova] Lock "2b514455-44b2-4115-bb13-38ba1713a263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8197ad06-980a-42fd-a79a-417aee8205cf req-87ef3e43-724d-4cf2-886b-ae6e3b275fc3 service nova] Lock "2b514455-44b2-4115-bb13-38ba1713a263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-8197ad06-980a-42fd-a79a-417aee8205cf req-87ef3e43-724d-4cf2-886b-ae6e3b275fc3 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] No waiting events found dispatching network-vif-plugged-db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:15 user nova-compute[74646]: WARNING nova.compute.manager [req-8197ad06-980a-42fd-a79a-417aee8205cf req-87ef3e43-724d-4cf2-886b-ae6e3b275fc3 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Received unexpected event network-vif-plugged-db3b9afe-9410-40a7-981e-cb59201a81b2 for instance with vm_state building and task_state spawning.
Oct 26 15:55:15 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:55:15 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Instance spawned successfully.
Oct 26 15:55:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:15 user nova-compute[74646]: INFO nova.compute.manager [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Took 6.26 seconds to spawn the instance on the hypervisor.
Oct 26 15:55:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:55:15 user nova-compute[74646]: INFO nova.compute.manager [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Took 7.19 seconds to build instance.
Oct 26 15:55:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c100bf87-6093-4737-94a5-6fcea1f5c1ea tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "2b514455-44b2-4115-bb13-38ba1713a263" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.325s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "2b514455-44b2-4115-bb13-38ba1713a263" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 4.359s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:15 user nova-compute[74646]: INFO nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 26 15:55:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "2b514455-44b2-4115-bb13-38ba1713a263" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:16 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:55:16 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:55:16 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:55:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:16 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:55:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:55:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:55:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:55:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:19 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:55:19 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:55:19 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8097MB free_disk=25.708938598632812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1c5d5313-72f0-4f49-83b7-f277d5da4191 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance ea252f48-c697-445e-bfc8-4a919b23aa83 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 8e30a4ad-5c27-4f92-8f1e-4ed081198588 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2b514455-44b2-4115-bb13-38ba1713a263 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:55:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:21 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:55:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:55:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-8e30a4ad-5c27-4f92-8f1e-4ed081198588" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:55:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-8e30a4ad-5c27-4f92-8f1e-4ed081198588" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:55:21 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 15:55:22 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Updating instance_info_cache with network_info: [{"id": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "address": "fa:16:3e:c2:f8:be", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11891582-29", "ovs_interfaceid": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:55:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-8e30a4ad-5c27-4f92-8f1e-4ed081198588" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:55:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 15:55:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:55:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:55:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:55:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:55:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:55:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:38 user nova-compute[74646]: INFO nova.compute.manager [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Terminating instance
Oct 26 15:55:38 user nova-compute[74646]: DEBUG nova.compute.manager [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 15:55:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-3cdf72fe-e197-48d2-8124-952ff8115b7e req-fbe62cf7-f7bc-44ac-8772-375a1558d931 service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Received event network-vif-unplugged-11891582-29b6-4bbc-ac85-8eb614bc6c8e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3cdf72fe-e197-48d2-8124-952ff8115b7e req-fbe62cf7-f7bc-44ac-8772-375a1558d931 service nova] Acquiring lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3cdf72fe-e197-48d2-8124-952ff8115b7e req-fbe62cf7-f7bc-44ac-8772-375a1558d931 service nova] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3cdf72fe-e197-48d2-8124-952ff8115b7e req-fbe62cf7-f7bc-44ac-8772-375a1558d931 service nova] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-3cdf72fe-e197-48d2-8124-952ff8115b7e req-fbe62cf7-f7bc-44ac-8772-375a1558d931 service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] No waiting events found dispatching network-vif-unplugged-11891582-29b6-4bbc-ac85-8eb614bc6c8e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-3cdf72fe-e197-48d2-8124-952ff8115b7e req-fbe62cf7-f7bc-44ac-8772-375a1558d931 service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Received event network-vif-unplugged-11891582-29b6-4bbc-ac85-8eb614bc6c8e for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:55:39 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Instance destroyed successfully.
Oct 26 15:55:39 user nova-compute[74646]: DEBUG nova.objects.instance [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lazy-loading 'resources' on Instance uuid 8e30a4ad-5c27-4f92-8f1e-4ed081198588 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:53:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1330341957',display_name='tempest-VolumesActionsTest-instance-1330341957',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1330341957',id=12,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:53:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9073433dc0b34618b5c52f010e49400e',ramdisk_id='',reservation_id='r-38h7qatv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1225783245',owner_user_name='tempest-VolumesActionsTest-1225783245-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:53:24Z,user_data=None,user_id='41bb4004c8444824bb91ff40a872c7cd',uuid=8e30a4ad-5c27-4f92-8f1e-4ed081198588,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "address": "fa:16:3e:c2:f8:be", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11891582-29", "ovs_interfaceid": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Converting VIF {"id": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "address": "fa:16:3e:c2:f8:be", "network": {"id": "fdc4cebd-c95f-4365-86a0-09b4b4a847b8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1392327895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9073433dc0b34618b5c52f010e49400e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11891582-29", "ovs_interfaceid": "11891582-29b6-4bbc-ac85-8eb614bc6c8e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:f8:be,bridge_name='br-int',has_traffic_filtering=True,id=11891582-29b6-4bbc-ac85-8eb614bc6c8e,network=Network(fdc4cebd-c95f-4365-86a0-09b4b4a847b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11891582-29') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG os_vif [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:f8:be,bridge_name='br-int',has_traffic_filtering=True,id=11891582-29b6-4bbc-ac85-8eb614bc6c8e,network=Network(fdc4cebd-c95f-4365-86a0-09b4b4a847b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11891582-29') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11891582-29, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9025c815-1c0f-4d48-af46-94217796b94b) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:39 user nova-compute[74646]: INFO os_vif [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:f8:be,bridge_name='br-int',has_traffic_filtering=True,id=11891582-29b6-4bbc-ac85-8eb614bc6c8e,network=Network(fdc4cebd-c95f-4365-86a0-09b4b4a847b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11891582-29')
Oct 26 15:55:39 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Deleting instance files /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588_del
Oct 26 15:55:39 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Deletion of /opt/stack/data/nova/instances/8e30a4ad-5c27-4f92-8f1e-4ed081198588_del complete
Oct 26 15:55:39 user nova-compute[74646]: INFO nova.compute.manager [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 26 15:55:39 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 15:55:39 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 15:55:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:40 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:55:40 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Took 0.91 seconds to deallocate network for instance.
Oct 26 15:55:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-33d44790-42f4-4e05-9278-f56315cf0bc8 req-3ece0506-30f3-4e6c-868e-7e9c25f74b7f service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Received event network-vif-deleted-11891582-29b6-4bbc-ac85-8eb614bc6c8e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:40 user nova-compute[74646]: INFO nova.compute.manager [req-33d44790-42f4-4e05-9278-f56315cf0bc8 req-3ece0506-30f3-4e6c-868e-7e9c25f74b7f service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Neutron deleted interface 11891582-29b6-4bbc-ac85-8eb614bc6c8e; detaching it from the instance and deleting it from the info cache
Oct 26 15:55:40 user nova-compute[74646]: DEBUG nova.network.neutron [req-33d44790-42f4-4e05-9278-f56315cf0bc8 req-3ece0506-30f3-4e6c-868e-7e9c25f74b7f service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:55:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-33d44790-42f4-4e05-9278-f56315cf0bc8 req-3ece0506-30f3-4e6c-868e-7e9c25f74b7f service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Detach interface failed, port_id=11891582-29b6-4bbc-ac85-8eb614bc6c8e, reason: Instance 8e30a4ad-5c27-4f92-8f1e-4ed081198588 could not be found. {{(pid=74646) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 15:55:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:41 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:55:41 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:55:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:41 user nova-compute[74646]: DEBUG nova.compute.manager [req-db62ee67-d3e4-4e89-a65d-b29124e9199e req-82a8c966-f372-41d4-a05d-652669531c17 service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Received event network-vif-plugged-11891582-29b6-4bbc-ac85-8eb614bc6c8e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-db62ee67-d3e4-4e89-a65d-b29124e9199e req-82a8c966-f372-41d4-a05d-652669531c17 service nova] Acquiring lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-db62ee67-d3e4-4e89-a65d-b29124e9199e req-82a8c966-f372-41d4-a05d-652669531c17 service nova] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-db62ee67-d3e4-4e89-a65d-b29124e9199e req-82a8c966-f372-41d4-a05d-652669531c17 service nova] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:41 user nova-compute[74646]: DEBUG nova.compute.manager [req-db62ee67-d3e4-4e89-a65d-b29124e9199e req-82a8c966-f372-41d4-a05d-652669531c17 service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] No waiting events found dispatching network-vif-plugged-11891582-29b6-4bbc-ac85-8eb614bc6c8e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:41 user nova-compute[74646]: WARNING nova.compute.manager [req-db62ee67-d3e4-4e89-a65d-b29124e9199e req-82a8c966-f372-41d4-a05d-652669531c17 service nova] [instance: 8e30a4ad-5c27-4f92-8f1e-4ed081198588] Received unexpected event network-vif-plugged-11891582-29b6-4bbc-ac85-8eb614bc6c8e for instance with vm_state deleted and task_state None.
Oct 26 15:55:41 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Deleted allocations for instance 8e30a4ad-5c27-4f92-8f1e-4ed081198588
Oct 26 15:55:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fda792d6-bed8-4171-a8ce-ccf830544ad2 tempest-VolumesActionsTest-1225783245 tempest-VolumesActionsTest-1225783245-project-member] Lock "8e30a4ad-5c27-4f92-8f1e-4ed081198588" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.603s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:41 user nova-compute[74646]: DEBUG nova.compute.manager [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:55:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:41 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:55:41 user nova-compute[74646]: INFO nova.compute.claims [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Claim successful on node user
Oct 26 15:55:42 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG nova.compute.manager [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG nova.compute.manager [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG nova.network.neutron [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG nova.policy [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86031b2e164644e0a59efcd110ddf497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c99559f6003420bb1014bdb0f0988ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:55:42 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:55:42 user nova-compute[74646]: DEBUG nova.compute.manager [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG nova.compute.manager [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:55:42 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Creating image(s)
Oct 26 15:55:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "/opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "/opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "/opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.185s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.192s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk 1073741824" returned: 0 in 0.059s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG nova.network.neutron [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Successfully created port: 3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.211s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Cannot resize image /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Ensure instance console log exists: /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG nova.network.neutron [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Successfully updated port: 3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquired lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:55:43 user nova-compute[74646]: DEBUG nova.network.neutron [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.compute.manager [req-4b29a55e-35b5-4e5d-8cf9-f39bca039d4f req-d4bec9a2-05c4-4ebf-beb5-0a4d7f27273c service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-changed-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.compute.manager [req-4b29a55e-35b5-4e5d-8cf9-f39bca039d4f req-d4bec9a2-05c4-4ebf-beb5-0a4d7f27273c service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Refreshing instance network info cache due to event network-changed-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4b29a55e-35b5-4e5d-8cf9-f39bca039d4f req-d4bec9a2-05c4-4ebf-beb5-0a4d7f27273c service nova] Acquiring lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.network.neutron [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.network.neutron [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating instance_info_cache with network_info: [{"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Releasing lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.compute.manager [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Instance network_info: |[{"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4b29a55e-35b5-4e5d-8cf9-f39bca039d4f req-d4bec9a2-05c4-4ebf-beb5-0a4d7f27273c service nova] Acquired lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.network.neutron [req-4b29a55e-35b5-4e5d-8cf9-f39bca039d4f req-d4bec9a2-05c4-4ebf-beb5-0a4d7f27273c service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Refreshing network info cache for port 3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Start _get_guest_xml network_info=[{"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:55:44 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:55:44 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-577894992',display_name='tempest-ServerActionsTestOtherB-server-577894992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-577894992',id=16,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8WuJBWWQ3dPKpsfd3pTt9BdyjBEif+cyL8w8Tg3VzJlkHtDxzbffk6KqqzEPT5s/X3OVnkganTQcqlWVpiRN+miRvt4exLQM5oDzUYlmj5/y40opmavHEPxTdEvfSLNw==',key_name='tempest-keypair-721457332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c99559f6003420bb1014bdb0f0988ff',ramdisk_id='',reservation_id='r-4yydauu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1825400277',owner_user_name='tempest-ServerActionsTestOtherB-1825400277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:55:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86031b2e164644e0a59efcd110ddf497',uuid=96a71d00-27f0-4dbe-88cb-e6f296178e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converting VIF {"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.objects.instance [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lazy-loading 'pci_devices' on Instance uuid 96a71d00-27f0-4dbe-88cb-e6f296178e90 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:55:44 user nova-compute[74646]:   <uuid>96a71d00-27f0-4dbe-88cb-e6f296178e90</uuid>
Oct 26 15:55:44 user nova-compute[74646]:   <name>instance-00000010</name>
Oct 26 15:55:44 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:55:44 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:55:44 user nova-compute[74646]:   <metadata>
Oct 26 15:55:44 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:55:44 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:55:44 user nova-compute[74646]:       <nova:name>tempest-ServerActionsTestOtherB-server-577894992</nova:name>
Oct 26 15:55:44 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:55:44</nova:creationTime>
Oct 26 15:55:44 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:55:44 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:55:44 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:55:44 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:55:44 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:55:44 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:55:44 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:55:44 user nova-compute[74646]:       <nova:owner>
Oct 26 15:55:44 user nova-compute[74646]:         <nova:user uuid="86031b2e164644e0a59efcd110ddf497">tempest-ServerActionsTestOtherB-1825400277-project-member</nova:user>
Oct 26 15:55:44 user nova-compute[74646]:         <nova:project uuid="5c99559f6003420bb1014bdb0f0988ff">tempest-ServerActionsTestOtherB-1825400277</nova:project>
Oct 26 15:55:44 user nova-compute[74646]:       </nova:owner>
Oct 26 15:55:44 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:55:44 user nova-compute[74646]:       <nova:ports>
Oct 26 15:55:44 user nova-compute[74646]:         <nova:port uuid="3e16bb7b-c1c2-4a11-aad9-2da2fbae632b">
Oct 26 15:55:44 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 15:55:44 user nova-compute[74646]:         </nova:port>
Oct 26 15:55:44 user nova-compute[74646]:       </nova:ports>
Oct 26 15:55:44 user nova-compute[74646]:     </nova:instance>
Oct 26 15:55:44 user nova-compute[74646]:   </metadata>
Oct 26 15:55:44 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:55:44 user nova-compute[74646]:     <system>
Oct 26 15:55:44 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:55:44 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:55:44 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:55:44 user nova-compute[74646]:       <entry name="serial">96a71d00-27f0-4dbe-88cb-e6f296178e90</entry>
Oct 26 15:55:44 user nova-compute[74646]:       <entry name="uuid">96a71d00-27f0-4dbe-88cb-e6f296178e90</entry>
Oct 26 15:55:44 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:55:44 user nova-compute[74646]:     </system>
Oct 26 15:55:44 user nova-compute[74646]:   </sysinfo>
Oct 26 15:55:44 user nova-compute[74646]:   <os>
Oct 26 15:55:44 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:55:44 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:55:44 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:55:44 user nova-compute[74646]:   </os>
Oct 26 15:55:44 user nova-compute[74646]:   <features>
Oct 26 15:55:44 user nova-compute[74646]:     <acpi/>
Oct 26 15:55:44 user nova-compute[74646]:     <apic/>
Oct 26 15:55:44 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:55:44 user nova-compute[74646]:   </features>
Oct 26 15:55:44 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:55:44 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:55:44 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:55:44 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:55:44 user nova-compute[74646]:   </clock>
Oct 26 15:55:44 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:55:44 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:55:44 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:55:44 user nova-compute[74646]:   </cpu>
Oct 26 15:55:44 user nova-compute[74646]:   <devices>
Oct 26 15:55:44 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:55:44 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:55:44 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk"/>
Oct 26 15:55:44 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:55:44 user nova-compute[74646]:     </disk>
Oct 26 15:55:44 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:55:44 user nova-compute[74646]:       <mac address="fa:16:3e:7e:a4:63"/>
Oct 26 15:55:44 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:55:44 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:55:44 user nova-compute[74646]:       <target dev="tap3e16bb7b-c1"/>
Oct 26 15:55:44 user nova-compute[74646]:     </interface>
Oct 26 15:55:44 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:55:44 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/console.log" append="off"/>
Oct 26 15:55:44 user nova-compute[74646]:     </serial>
Oct 26 15:55:44 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:55:44 user nova-compute[74646]:     <video>
Oct 26 15:55:44 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:55:44 user nova-compute[74646]:     </video>
Oct 26 15:55:44 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:55:44 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:55:44 user nova-compute[74646]:     </rng>
Oct 26 15:55:44 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:55:44 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:55:44 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:55:44 user nova-compute[74646]:     </memballoon>
Oct 26 15:55:44 user nova-compute[74646]:   </devices>
Oct 26 15:55:44 user nova-compute[74646]: </domain>
Oct 26 15:55:44 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-577894992',display_name='tempest-ServerActionsTestOtherB-server-577894992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-577894992',id=16,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8WuJBWWQ3dPKpsfd3pTt9BdyjBEif+cyL8w8Tg3VzJlkHtDxzbffk6KqqzEPT5s/X3OVnkganTQcqlWVpiRN+miRvt4exLQM5oDzUYlmj5/y40opmavHEPxTdEvfSLNw==',key_name='tempest-keypair-721457332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5c99559f6003420bb1014bdb0f0988ff',ramdisk_id='',reservation_id='r-4yydauu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1825400277',owner_user_name='tempest-ServerActionsTestOtherB-1825400277-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:55:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86031b2e164644e0a59efcd110ddf497',uuid=96a71d00-27f0-4dbe-88cb-e6f296178e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converting VIF {"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG os_vif [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05023755-74fa-5a87-9bba-64208721fb30', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e16bb7b-c1, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e16bb7b-c1, col_values=(('qos', UUID('0abdfd69-0df1-480d-9837-e2c41ccca168')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e16bb7b-c1, col_values=(('external_ids', {'iface-id': '3e16bb7b-c1c2-4a11-aad9-2da2fbae632b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:a4:63', 'vm-uuid': '96a71d00-27f0-4dbe-88cb-e6f296178e90'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:44 user nova-compute[74646]: INFO os_vif [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1')
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] No VIF found with MAC fa:16:3e:7e:a4:63, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.network.neutron [req-4b29a55e-35b5-4e5d-8cf9-f39bca039d4f req-d4bec9a2-05c4-4ebf-beb5-0a4d7f27273c service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updated VIF entry in instance network info cache for port 3e16bb7b-c1c2-4a11-aad9-2da2fbae632b. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG nova.network.neutron [req-4b29a55e-35b5-4e5d-8cf9-f39bca039d4f req-d4bec9a2-05c4-4ebf-beb5-0a4d7f27273c service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating instance_info_cache with network_info: [{"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:55:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4b29a55e-35b5-4e5d-8cf9-f39bca039d4f req-d4bec9a2-05c4-4ebf-beb5-0a4d7f27273c service nova] Releasing lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:55:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.compute.manager [req-fa592e6f-03aa-4b62-acda-54eeed848937 req-3c4d14fc-e9ec-4b10-9cd1-2b5829959718 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fa592e6f-03aa-4b62-acda-54eeed848937 req-3c4d14fc-e9ec-4b10-9cd1-2b5829959718 service nova] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fa592e6f-03aa-4b62-acda-54eeed848937 req-3c4d14fc-e9ec-4b10-9cd1-2b5829959718 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fa592e6f-03aa-4b62-acda-54eeed848937 req-3c4d14fc-e9ec-4b10-9cd1-2b5829959718 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.compute.manager [req-fa592e6f-03aa-4b62-acda-54eeed848937 req-3c4d14fc-e9ec-4b10-9cd1-2b5829959718 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] No waiting events found dispatching network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:46 user nova-compute[74646]: WARNING nova.compute.manager [req-fa592e6f-03aa-4b62-acda-54eeed848937 req-3c4d14fc-e9ec-4b10-9cd1-2b5829959718 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received unexpected event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b for instance with vm_state building and task_state spawning.
Oct 26 15:55:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:55:46 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Creating image(s)
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Ensure instance console log exists: /opt/stack/data/nova/instances/72c080e8-7d97-41c2-8dc3-4e70dab3b9d7/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Start _get_guest_xml network_info=[{"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b891259-d291-4d80-bac2-c269b053975d", "address": "fa:16:3e:8f:e1:3d", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b891259-d2", "ovs_interfaceid": "7b891259-d291-4d80-bac2-c269b053975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '92158b16-1a5c-447e-84f7-555f10e2496f', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CSWBxewp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72c080e8-7d97-41c2-8dc3-4e70dab3b9d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c2de8e96-f8c2-43e4-b543-ed3e9349e2e0', 'serial': 'c2de8e96-f8c2-43e4-b543-ed3e9349e2e0'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'boot_index': 1, 'mount_device': '/dev/vdb', 'attachment_id': 'be02b93c-c532-479f-a7bc-ed252b93bafb', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SBWuzNUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72c080e8-7d97-41c2-8dc3-4e70dab3b9d7', 'attached_at': '', 'detached_at': '', 'volume_id': '8cb56e7e-52ac-42eb-ba50-23f42b33acb8', 'serial': '8cb56e7e-52ac-42eb-ba50-23f42b33acb8'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None}, {'guest_format': None, 'boot_index': 2, 'mount_device': '/dev/vdc', 'attachment_id': '0a93e5f8-d86f-4efe-8b51-1e77b86ff081', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpqUSIPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72c080e8-7d97-41c2-8dc3-4e70dab3b9d7', 'attached_at': '', 'detached_at': '', 'volume_id': 'c85cc118-93ba-4153-abde-48c41d13909b', 'serial': 'c85cc118-93ba-4153-abde-48c41d13909b'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:55:46 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:55:46 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CSWBxewp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:55:46 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:55:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:55:46 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:55:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:55:46 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[af3f1660-4dfe-4cdf-bcbe-680ff4143c11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:55:46 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dcc52d-dba8-4244-80d9-141a726e66b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0] added
Oct 26 15:55:46 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab921fc8-39d9-4852-a4c2-5ea99c7fcb33]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5e0f15-d7ac-4bcc-992c-ccdf7c3533b6]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CSWBxewp {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CSWBxewp" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f204ff2b-a7a7-4a80-8154-c8a5ee2ecb9a]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CSWBxewp'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1694aa36-a647-4a5c-a7c9-ccdb0fffe528]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cabf65b8-8342-47e1-b7b9-5bad9ef158d4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:55:47 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:55:47 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:55:47 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:55:47 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:55:47 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:55:47 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8efa76-f038-4272-a7c9-abcf247e161a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0, portal: 172.16.0.220,3260]
Oct 26 15:55:47 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0, portal: 172.16.0.220,3260] successful.
Oct 26 15:55:47 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e0ccdf-cd47-4ec6-abe4-319a8ba4515e]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[688ee280-61de-448e-bd40-8fe9710940cd]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:55:47 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:55:47 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:55:47 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:55:47 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:55:47 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:55:47 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:55:47 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:55:47 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b98d1f3-ec56-44d6-84e7-fe8eaa409d7e]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:47 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: None {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:55:48 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Instance spawned successfully.
Oct 26 15:55:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CSWBxewp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26430643366336439', 'path': '/dev/sde'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430643366336439', 'path': '/dev/sde'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-d74cd99f-d68e-4b2c-b3fe-dc3901034032 req-09309f5a-2785-489d-9d1e-d09023b2c2f2 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d74cd99f-d68e-4b2c-b3fe-dc3901034032 req-09309f5a-2785-489d-9d1e-d09023b2c2f2 service nova] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d74cd99f-d68e-4b2c-b3fe-dc3901034032 req-09309f5a-2785-489d-9d1e-d09023b2c2f2 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d74cd99f-d68e-4b2c-b3fe-dc3901034032 req-09309f5a-2785-489d-9d1e-d09023b2c2f2 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-d74cd99f-d68e-4b2c-b3fe-dc3901034032 req-09309f5a-2785-489d-9d1e-d09023b2c2f2 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] No waiting events found dispatching network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:48 user nova-compute[74646]: WARNING nova.compute.manager [req-d74cd99f-d68e-4b2c-b3fe-dc3901034032 req-09309f5a-2785-489d-9d1e-d09023b2c2f2 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received unexpected event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b for instance with vm_state building and task_state spawning.
Oct 26 15:55:48 user nova-compute[74646]: INFO nova.compute.manager [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Took 5.57 seconds to spawn the instance on the hypervisor.
Oct 26 15:55:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SBWuzNUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:55:48 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:55:48 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:55:48 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f84f0e8-2a1a-4ec9-84f7-aa1ab9066956]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:55:48 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c1b3ac-c670-4bed-ad3b-7d243e2cf88c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8] added
Oct 26 15:55:48 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31265b7-0fd3-4937-a2ad-62790faeac39]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:48 user nova-compute[74646]: INFO nova.compute.manager [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Took 6.71 seconds to build instance.
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[20bb1095-ee82-4766-af0f-a934043ba85d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SBWuzNUM {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-50b01eae-b63c-4d51-8f0f-865b86e6af3d tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.823s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SBWuzNUM" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67c4ab0-63d5-4a6a-b152-c20f36af8286]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SBWuzNUM'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1092ef9-94f2-4f7b-b791-52578b5d0059]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd21d54b-ec6f-48c3-a3f8-09d5489a2a81]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:55:48 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:55:48 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:55:48 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:55:48 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:55:48 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:55:48 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:55:48 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:55:48 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[85dfa783-49d2-4366-9788-ce464c6d5717]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8, portal: 172.16.0.220,3260]
Oct 26 15:55:48 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8, portal: 172.16.0.220,3260] successful.
Oct 26 15:55:48 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c5a58e-df98-4dc7-8229-2465b5e12181]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9539732-7a60-4867-80fb-f9d2cc9e2215]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:55:48 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:55:48 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:55:48 user nova-compute[74646]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)
Oct 26 15:55:48 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:55:48 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:55:48 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:55:48 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:55:48 user nova-compute[74646]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)
Oct 26 15:55:48 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:55:48 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab7c0b7-e0f7-4c1e-9efe-5b5ea708a38e]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:55:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SBWuzNUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26165376531643333', 'path': '/dev/sdf'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165376531643333', 'path': '/dev/sdf'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpqUSIPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:55:49 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:55:49 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:55:49 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3eb318b-69df-469a-8774-e610e873445b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:55:49 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[437d6be1-4e53-4a96-874d-e75fc8014c87]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b] added
Oct 26 15:55:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d5a39e-82fd-4b11-9c92-4214b976173e]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[45af7690-9d7f-4c71-9989-a44170158658]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cpqUSIPC {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cpqUSIPC" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb83da6-31c1-46c4-8def-36eafdaf5192]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cpqUSIPC'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e921d20c-91e9-44d7-bac9-ca8008a0d4ec]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf8c16d-dc05-48c4-b339-bad009980bbb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:55:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:55:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[265f7ffa-b08e-4a3e-82df-a6f7bcdcdfe6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b, portal: 172.16.0.220,3260]
Oct 26 15:55:49 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b, portal: 172.16.0.220,3260] successful.
Oct 26 15:55:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bf907b-29b4-477e-b8ee-43743a3d4b99]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aef586-24a8-493c-95de-d4b35eb7f84b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:55:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)
Oct 26 15:55:49 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:55:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] HCTL ('38', '-', '-', 0) found on session 14 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:55:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a832db7d-35fe-4d3d-bfe3-c264095782a2]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:55:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Searching for a device in session 14 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:55:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpqUSIPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:55:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23730363566366563', 'path': '/dev/sdg'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23730363566366563', 'path': '/dev/sdg'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d6:d5,bridge_name='br-int',has_traffic_filtering=True,id=d60a67d2-ef24-4bd3-a395-c9a4a6db73a2,network=Network(8ba36fd9-4d7e-4597-8695-d8a4d86f90b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60a67d2-ef') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:49:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca4e1d8b-97cd-4389-ad34-7f6a290740c0,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapca4e1d8b-97') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ee:38,bridge_name='br-int',has_traffic_filtering=True,id=6e68929c-fcd8-41eb-b969-28df0d9a1b4e,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e68929c-fc') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b891259-d291-4d80-bac2-c269b053975d", "address": "fa:16:3e:8f:e1:3d", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b891259-d2", "ovs_interfaceid": "7b891259-d291-4d80-bac2-c269b053975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "7b891259-d291-4d80-bac2-c269b053975d", "address": "fa:16:3e:8f:e1:3d", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b891259-d2", "ovs_interfaceid": "7b891259-d291-4d80-bac2-c269b053975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e1:3d,bridge_name='br-int',has_traffic_filtering=True,id=7b891259-d291-4d80-bac2-c269b053975d,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b891259-d2') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:75:f7,bridge_name='br-int',has_traffic_filtering=True,id=80847d8e-3acc-4bfd-8ae6-f772c5212e2e,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80847d8e-3a') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:6e,bridge_name='br-int',has_traffic_filtering=True,id=25359995-da39-408c-85d6-7f9b16b8c3f9,network=Network(8ceff406-3578-4a98-a333-474334644fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25359995-da') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:65:36,bridge_name='br-int',has_traffic_filtering=True,id=22241012-3061-44ab-b747-14a46854c933,network=Network(8ceff406-3578-4a98-a333-474334644fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22241012-30') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.objects.instance [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lazy-loading 'pci_devices' on Instance uuid 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:55:51 user nova-compute[74646]:   <uuid>72c080e8-7d97-41c2-8dc3-4e70dab3b9d7</uuid>
Oct 26 15:55:51 user nova-compute[74646]:   <name>instance-0000000a</name>
Oct 26 15:55:51 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:55:51 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:55:51 user nova-compute[74646]:   <metadata>
Oct 26 15:55:51 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:55:51 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:55:51 user nova-compute[74646]:       <nova:name>tempest-device-tagging-server-79914725</nova:name>
Oct 26 15:55:51 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:55:46</nova:creationTime>
Oct 26 15:55:51 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:55:51 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:55:51 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:55:51 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:55:51 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:55:51 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:55:51 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:55:51 user nova-compute[74646]:       <nova:owner>
Oct 26 15:55:51 user nova-compute[74646]:         <nova:user uuid="0e35d67fdc0e46b098e239342ef9e506">tempest-TaggedBootDevicesTest-414809244-project-member</nova:user>
Oct 26 15:55:51 user nova-compute[74646]:         <nova:project uuid="dd31de955f0540b89ca2d4bcaaf5746e">tempest-TaggedBootDevicesTest-414809244</nova:project>
Oct 26 15:55:51 user nova-compute[74646]:       </nova:owner>
Oct 26 15:55:51 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:55:51 user nova-compute[74646]:       <nova:ports>
Oct 26 15:55:51 user nova-compute[74646]:         <nova:port uuid="d60a67d2-ef24-4bd3-a395-c9a4a6db73a2">
Oct 26 15:55:51 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 15:55:51 user nova-compute[74646]:         </nova:port>
Oct 26 15:55:51 user nova-compute[74646]:         <nova:port uuid="ca4e1d8b-97cd-4389-ad34-7f6a290740c0">
Oct 26 15:55:51 user nova-compute[74646]:           <nova:ip type="fixed" address="10.1.1.228" ipVersion="4"/>
Oct 26 15:55:51 user nova-compute[74646]:         </nova:port>
Oct 26 15:55:51 user nova-compute[74646]:         <nova:port uuid="6e68929c-fcd8-41eb-b969-28df0d9a1b4e">
Oct 26 15:55:51 user nova-compute[74646]:           <nova:ip type="fixed" address="10.1.1.129" ipVersion="4"/>
Oct 26 15:55:51 user nova-compute[74646]:         </nova:port>
Oct 26 15:55:51 user nova-compute[74646]:         <nova:port uuid="7b891259-d291-4d80-bac2-c269b053975d">
Oct 26 15:55:51 user nova-compute[74646]:           <nova:ip type="fixed" address="10.1.1.151" ipVersion="4"/>
Oct 26 15:55:51 user nova-compute[74646]:         </nova:port>
Oct 26 15:55:51 user nova-compute[74646]:         <nova:port uuid="80847d8e-3acc-4bfd-8ae6-f772c5212e2e">
Oct 26 15:55:51 user nova-compute[74646]:           <nova:ip type="fixed" address="10.1.1.157" ipVersion="4"/>
Oct 26 15:55:51 user nova-compute[74646]:         </nova:port>
Oct 26 15:55:51 user nova-compute[74646]:         <nova:port uuid="25359995-da39-408c-85d6-7f9b16b8c3f9">
Oct 26 15:55:51 user nova-compute[74646]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 26 15:55:51 user nova-compute[74646]:         </nova:port>
Oct 26 15:55:51 user nova-compute[74646]:         <nova:port uuid="22241012-3061-44ab-b747-14a46854c933">
Oct 26 15:55:51 user nova-compute[74646]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 26 15:55:51 user nova-compute[74646]:         </nova:port>
Oct 26 15:55:51 user nova-compute[74646]:       </nova:ports>
Oct 26 15:55:51 user nova-compute[74646]:     </nova:instance>
Oct 26 15:55:51 user nova-compute[74646]:   </metadata>
Oct 26 15:55:51 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:55:51 user nova-compute[74646]:     <system>
Oct 26 15:55:51 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:55:51 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:55:51 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:55:51 user nova-compute[74646]:       <entry name="serial">72c080e8-7d97-41c2-8dc3-4e70dab3b9d7</entry>
Oct 26 15:55:51 user nova-compute[74646]:       <entry name="uuid">72c080e8-7d97-41c2-8dc3-4e70dab3b9d7</entry>
Oct 26 15:55:51 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:55:51 user nova-compute[74646]:     </system>
Oct 26 15:55:51 user nova-compute[74646]:   </sysinfo>
Oct 26 15:55:51 user nova-compute[74646]:   <os>
Oct 26 15:55:51 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:55:51 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:55:51 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:55:51 user nova-compute[74646]:   </os>
Oct 26 15:55:51 user nova-compute[74646]:   <features>
Oct 26 15:55:51 user nova-compute[74646]:     <acpi/>
Oct 26 15:55:51 user nova-compute[74646]:     <apic/>
Oct 26 15:55:51 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:55:51 user nova-compute[74646]:   </features>
Oct 26 15:55:51 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:55:51 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:55:51 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:55:51 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:55:51 user nova-compute[74646]:   </clock>
Oct 26 15:55:51 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:55:51 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:55:51 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:55:51 user nova-compute[74646]:   </cpu>
Oct 26 15:55:51 user nova-compute[74646]:   <devices>
Oct 26 15:55:51 user nova-compute[74646]:     <disk type="file" device="cdrom">
Oct 26 15:55:51 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none"/>
Oct 26 15:55:51 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/72c080e8-7d97-41c2-8dc3-4e70dab3b9d7/disk.config"/>
Oct 26 15:55:51 user nova-compute[74646]:       <target dev="hda" bus="ide"/>
Oct 26 15:55:51 user nova-compute[74646]:     </disk>
Oct 26 15:55:51 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 15:55:51 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:55:51 user nova-compute[74646]:       <source dev="/dev/sde"/>
Oct 26 15:55:51 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:55:51 user nova-compute[74646]:       <serial>c2de8e96-f8c2-43e4-b543-ed3e9349e2e0</serial>
Oct 26 15:55:51 user nova-compute[74646]:     </disk>
Oct 26 15:55:51 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 15:55:51 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:55:51 user nova-compute[74646]:       <source dev="/dev/sdf"/>
Oct 26 15:55:51 user nova-compute[74646]:       <target dev="vdb" bus="virtio"/>
Oct 26 15:55:51 user nova-compute[74646]:       <serial>8cb56e7e-52ac-42eb-ba50-23f42b33acb8</serial>
Oct 26 15:55:51 user nova-compute[74646]:     </disk>
Oct 26 15:55:51 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 15:55:51 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:55:51 user nova-compute[74646]:       <source dev="/dev/sdg"/>
Oct 26 15:55:51 user nova-compute[74646]:       <target dev="vdc" bus="virtio"/>
Oct 26 15:55:51 user nova-compute[74646]:       <serial>c85cc118-93ba-4153-abde-48c41d13909b</serial>
Oct 26 15:55:51 user nova-compute[74646]:     </disk>
Oct 26 15:55:51 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:55:51 user nova-compute[74646]:       <mac address="fa:16:3e:ff:d6:d5"/>
Oct 26 15:55:51 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:55:51 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:55:51 user nova-compute[74646]:       <target dev="tapd60a67d2-ef"/>
Oct 26 15:55:51 user nova-compute[74646]:     </interface>
Oct 26 15:55:51 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:55:51 user nova-compute[74646]:       <mac address="fa:16:3e:cd:49:e8"/>
Oct 26 15:55:51 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:55:51 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:55:51 user nova-compute[74646]:       <target dev="tapca4e1d8b-97"/>
Oct 26 15:55:51 user nova-compute[74646]:     </interface>
Oct 26 15:55:51 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:55:51 user nova-compute[74646]:       <mac address="fa:16:3e:cf:ee:38"/>
Oct 26 15:55:51 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:55:51 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:55:51 user nova-compute[74646]:       <target dev="tap6e68929c-fc"/>
Oct 26 15:55:51 user nova-compute[74646]:     </interface>
Oct 26 15:55:51 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:55:51 user nova-compute[74646]:       <mac address="fa:16:3e:8f:e1:3d"/>
Oct 26 15:55:51 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:55:51 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:55:51 user nova-compute[74646]:       <target dev="tap7b891259-d2"/>
Oct 26 15:55:51 user nova-compute[74646]:     </interface>
Oct 26 15:55:51 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:55:51 user nova-compute[74646]:       <mac address="fa:16:3e:21:75:f7"/>
Oct 26 15:55:51 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:55:51 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:55:51 user nova-compute[74646]:       <target dev="tap80847d8e-3a"/>
Oct 26 15:55:51 user nova-compute[74646]:     </interface>
Oct 26 15:55:51 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:55:51 user nova-compute[74646]:       <mac address="fa:16:3e:11:8d:6e"/>
Oct 26 15:55:51 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:55:51 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:55:51 user nova-compute[74646]:       <target dev="tap25359995-da"/>
Oct 26 15:55:51 user nova-compute[74646]:     </interface>
Oct 26 15:55:51 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:55:51 user nova-compute[74646]:       <mac address="fa:16:3e:c8:65:36"/>
Oct 26 15:55:51 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:55:51 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:55:51 user nova-compute[74646]:       <target dev="tap22241012-30"/>
Oct 26 15:55:51 user nova-compute[74646]:     </interface>
Oct 26 15:55:51 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:55:51 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/72c080e8-7d97-41c2-8dc3-4e70dab3b9d7/console.log" append="off"/>
Oct 26 15:55:51 user nova-compute[74646]:     </serial>
Oct 26 15:55:51 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:55:51 user nova-compute[74646]:     <video>
Oct 26 15:55:51 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:55:51 user nova-compute[74646]:     </video>
Oct 26 15:55:51 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:55:51 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:55:51 user nova-compute[74646]:     </rng>
Oct 26 15:55:51 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:55:51 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:55:51 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:55:51 user nova-compute[74646]:     </memballoon>
Oct 26 15:55:51 user nova-compute[74646]:   </devices>
Oct 26 15:55:51 user nova-compute[74646]: </domain>
Oct 26 15:55:51 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d6:d5,bridge_name='br-int',has_traffic_filtering=True,id=d60a67d2-ef24-4bd3-a395-c9a4a6db73a2,network=Network(8ba36fd9-4d7e-4597-8695-d8a4d86f90b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60a67d2-ef') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG os_vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d6:d5,bridge_name='br-int',has_traffic_filtering=True,id=d60a67d2-ef24-4bd3-a395-c9a4a6db73a2,network=Network(8ba36fd9-4d7e-4597-8695-d8a4d86f90b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60a67d2-ef') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '76ffa793-44aa-51bd-b705-c6a2490f9513', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd60a67d2-ef, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd60a67d2-ef, col_values=(('qos', UUID('ca15e81d-5fc4-42a2-8ec0-7ee0d6f2cdf9')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd60a67d2-ef, col_values=(('external_ids', {'iface-id': 'd60a67d2-ef24-4bd3-a395-c9a4a6db73a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:d6:d5', 'vm-uuid': '72c080e8-7d97-41c2-8dc3-4e70dab3b9d7'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: INFO os_vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:d6:d5,bridge_name='br-int',has_traffic_filtering=True,id=d60a67d2-ef24-4bd3-a395-c9a4a6db73a2,network=Network(8ba36fd9-4d7e-4597-8695-d8a4d86f90b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60a67d2-ef')
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:49:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca4e1d8b-97cd-4389-ad34-7f6a290740c0,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapca4e1d8b-97') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG os_vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:49:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca4e1d8b-97cd-4389-ad34-7f6a290740c0,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapca4e1d8b-97') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d09daeb-caec-5cd0-8508-3261c1563cdb', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca4e1d8b-97, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca4e1d8b-97, col_values=(('qos', UUID('e6781f7d-bd53-48fd-99f1-e143ebf8d4fd')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca4e1d8b-97, col_values=(('external_ids', {'iface-id': 'ca4e1d8b-97cd-4389-ad34-7f6a290740c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:49:e8', 'vm-uuid': '72c080e8-7d97-41c2-8dc3-4e70dab3b9d7'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: INFO os_vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:49:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca4e1d8b-97cd-4389-ad34-7f6a290740c0,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapca4e1d8b-97')
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ee:38,bridge_name='br-int',has_traffic_filtering=True,id=6e68929c-fcd8-41eb-b969-28df0d9a1b4e,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e68929c-fc') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG os_vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ee:38,bridge_name='br-int',has_traffic_filtering=True,id=6e68929c-fcd8-41eb-b969-28df0d9a1b4e,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e68929c-fc') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '294b114b-d85a-5ce9-bbcd-57b8783d5aab', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6e68929c-fc, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6e68929c-fc, col_values=(('qos', UUID('1672253d-cb57-48ea-8353-8ff64119b8fa')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6e68929c-fc, col_values=(('external_ids', {'iface-id': '6e68929c-fcd8-41eb-b969-28df0d9a1b4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:ee:38', 'vm-uuid': '72c080e8-7d97-41c2-8dc3-4e70dab3b9d7'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: INFO os_vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ee:38,bridge_name='br-int',has_traffic_filtering=True,id=6e68929c-fcd8-41eb-b969-28df0d9a1b4e,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e68929c-fc')
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b891259-d291-4d80-bac2-c269b053975d", "address": "fa:16:3e:8f:e1:3d", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b891259-d2", "ovs_interfaceid": "7b891259-d291-4d80-bac2-c269b053975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "7b891259-d291-4d80-bac2-c269b053975d", "address": "fa:16:3e:8f:e1:3d", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b891259-d2", "ovs_interfaceid": "7b891259-d291-4d80-bac2-c269b053975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e1:3d,bridge_name='br-int',has_traffic_filtering=True,id=7b891259-d291-4d80-bac2-c269b053975d,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b891259-d2') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG os_vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e1:3d,bridge_name='br-int',has_traffic_filtering=True,id=7b891259-d291-4d80-bac2-c269b053975d,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b891259-d2') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5d46bfb-1d2b-567f-aa0e-3beabf895803', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b891259-d2, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b891259-d2, col_values=(('qos', UUID('38085aa4-2d0b-4ed6-b648-f1105818a406')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b891259-d2, col_values=(('external_ids', {'iface-id': '7b891259-d291-4d80-bac2-c269b053975d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:e1:3d', 'vm-uuid': '72c080e8-7d97-41c2-8dc3-4e70dab3b9d7'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: INFO os_vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e1:3d,bridge_name='br-int',has_traffic_filtering=True,id=7b891259-d291-4d80-bac2-c269b053975d,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b891259-d2')
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:75:f7,bridge_name='br-int',has_traffic_filtering=True,id=80847d8e-3acc-4bfd-8ae6-f772c5212e2e,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80847d8e-3a') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG os_vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:75:f7,bridge_name='br-int',has_traffic_filtering=True,id=80847d8e-3acc-4bfd-8ae6-f772c5212e2e,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80847d8e-3a') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ffdc9ae-1cb6-5bb7-815d-cf00a76bd04d', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80847d8e-3a, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80847d8e-3a, col_values=(('qos', UUID('9fbb8049-551b-40e4-9601-d615e57dd931')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80847d8e-3a, col_values=(('external_ids', {'iface-id': '80847d8e-3acc-4bfd-8ae6-f772c5212e2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:75:f7', 'vm-uuid': '72c080e8-7d97-41c2-8dc3-4e70dab3b9d7'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: INFO os_vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:75:f7,bridge_name='br-int',has_traffic_filtering=True,id=80847d8e-3acc-4bfd-8ae6-f772c5212e2e,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80847d8e-3a')
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:6e,bridge_name='br-int',has_traffic_filtering=True,id=25359995-da39-408c-85d6-7f9b16b8c3f9,network=Network(8ceff406-3578-4a98-a333-474334644fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25359995-da') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG os_vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:6e,bridge_name='br-int',has_traffic_filtering=True,id=25359995-da39-408c-85d6-7f9b16b8c3f9,network=Network(8ceff406-3578-4a98-a333-474334644fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25359995-da') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5bab1f9e-06a2-5938-b327-33e1456237a7', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25359995-da, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25359995-da, col_values=(('qos', UUID('6f6db8fc-c8ad-4152-8fa0-9e30b6658e46')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25359995-da, col_values=(('external_ids', {'iface-id': '25359995-da39-408c-85d6-7f9b16b8c3f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:8d:6e', 'vm-uuid': '72c080e8-7d97-41c2-8dc3-4e70dab3b9d7'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: INFO os_vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:6e,bridge_name='br-int',has_traffic_filtering=True,id=25359995-da39-408c-85d6-7f9b16b8c3f9,network=Network(8ceff406-3578-4a98-a333-474334644fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25359995-da')
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:51:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:65:36,bridge_name='br-int',has_traffic_filtering=True,id=22241012-3061-44ab-b747-14a46854c933,network=Network(8ceff406-3578-4a98-a333-474334644fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22241012-30') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG os_vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:65:36,bridge_name='br-int',has_traffic_filtering=True,id=22241012-3061-44ab-b747-14a46854c933,network=Network(8ceff406-3578-4a98-a333-474334644fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22241012-30') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb8d35e2-b707-5744-a3c2-5174c71d899c', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22241012-30, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap22241012-30, col_values=(('qos', UUID('d2972c95-5579-4f79-9f45-747b39dcbea0')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap22241012-30, col_values=(('external_ids', {'iface-id': '22241012-3061-44ab-b747-14a46854c933', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c8:65:36', 'vm-uuid': '72c080e8-7d97-41c2-8dc3-4e70dab3b9d7'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:55:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:55:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:52 user nova-compute[74646]: INFO os_vif [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:65:36,bridge_name='br-int',has_traffic_filtering=True,id=22241012-3061-44ab-b747-14a46854c933,network=Network(8ceff406-3578-4a98-a333-474334644fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22241012-30')
Oct 26 15:55:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] No BDM found with device name hda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:55:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:55:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] No VIF found with MAC fa:16:3e:ff:d6:d5, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:55:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] No VIF found with MAC fa:16:3e:21:75:f7, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:55:52 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Using config drive
Oct 26 15:55:52 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Creating config drive at /opt/stack/data/nova/instances/72c080e8-7d97-41c2-8dc3-4e70dab3b9d7/disk.config
Oct 26 15:55:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/72c080e8-7d97-41c2-8dc3-4e70dab3b9d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplgi2ykm1 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:55:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/72c080e8-7d97-41c2-8dc3-4e70dab3b9d7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplgi2ykm1" returned: 0 in 0.062s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:55:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG nova.compute.manager [req-5f7c54c0-95a4-4af2-a59b-9d819c83b935 req-78bc3886-f222-4c63-aeb6-1c8cf885de7d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5f7c54c0-95a4-4af2-a59b-9d819c83b935 req-78bc3886-f222-4c63-aeb6-1c8cf885de7d service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5f7c54c0-95a4-4af2-a59b-9d819c83b935 req-78bc3886-f222-4c63-aeb6-1c8cf885de7d service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5f7c54c0-95a4-4af2-a59b-9d819c83b935 req-78bc3886-f222-4c63-aeb6-1c8cf885de7d service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG nova.compute.manager [req-5f7c54c0-95a4-4af2-a59b-9d819c83b935 req-78bc3886-f222-4c63-aeb6-1c8cf885de7d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:54 user nova-compute[74646]: WARNING nova.compute.manager [req-5f7c54c0-95a4-4af2-a59b-9d819c83b935 req-78bc3886-f222-4c63-aeb6-1c8cf885de7d service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 for instance with vm_state building and task_state spawning.
Oct 26 15:55:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG nova.compute.manager [req-0e950b1b-2200-484b-a0be-b252a24ccacd req-e40d64eb-a7bc-453e-b6de-9d27ca007cbc service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-ca4e1d8b-97cd-4389-ad34-7f6a290740c0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0e950b1b-2200-484b-a0be-b252a24ccacd req-e40d64eb-a7bc-453e-b6de-9d27ca007cbc service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0e950b1b-2200-484b-a0be-b252a24ccacd req-e40d64eb-a7bc-453e-b6de-9d27ca007cbc service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0e950b1b-2200-484b-a0be-b252a24ccacd req-e40d64eb-a7bc-453e-b6de-9d27ca007cbc service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG nova.compute.manager [req-0e950b1b-2200-484b-a0be-b252a24ccacd req-e40d64eb-a7bc-453e-b6de-9d27ca007cbc service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-ca4e1d8b-97cd-4389-ad34-7f6a290740c0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:54 user nova-compute[74646]: WARNING nova.compute.manager [req-0e950b1b-2200-484b-a0be-b252a24ccacd req-e40d64eb-a7bc-453e-b6de-9d27ca007cbc service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-ca4e1d8b-97cd-4389-ad34-7f6a290740c0 for instance with vm_state building and task_state spawning.
Oct 26 15:55:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:56 user nova-compute[74646]: WARNING nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 for instance with vm_state building and task_state spawning.
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-6e68929c-fcd8-41eb-b969-28df0d9a1b4e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-6e68929c-fcd8-41eb-b969-28df0d9a1b4e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:56 user nova-compute[74646]: WARNING nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-6e68929c-fcd8-41eb-b969-28df0d9a1b4e for instance with vm_state building and task_state spawning.
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-6e68929c-fcd8-41eb-b969-28df0d9a1b4e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-6e68929c-fcd8-41eb-b969-28df0d9a1b4e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:56 user nova-compute[74646]: WARNING nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-6e68929c-fcd8-41eb-b969-28df0d9a1b4e for instance with vm_state building and task_state spawning.
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-7b891259-d291-4d80-bac2-c269b053975d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-7b891259-d291-4d80-bac2-c269b053975d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:56 user nova-compute[74646]: WARNING nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-7b891259-d291-4d80-bac2-c269b053975d for instance with vm_state building and task_state spawning.
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-7b891259-d291-4d80-bac2-c269b053975d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-7b891259-d291-4d80-bac2-c269b053975d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:56 user nova-compute[74646]: WARNING nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-7b891259-d291-4d80-bac2-c269b053975d for instance with vm_state building and task_state spawning.
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-80847d8e-3acc-4bfd-8ae6-f772c5212e2e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-80847d8e-3acc-4bfd-8ae6-f772c5212e2e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:56 user nova-compute[74646]: WARNING nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-80847d8e-3acc-4bfd-8ae6-f772c5212e2e for instance with vm_state building and task_state spawning.
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-80847d8e-3acc-4bfd-8ae6-f772c5212e2e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-80847d8e-3acc-4bfd-8ae6-f772c5212e2e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:56 user nova-compute[74646]: WARNING nova.compute.manager [req-29e7587f-bfac-4a6e-837c-f208eae111e0 req-2f36a6ab-b531-42d4-94d0-b052769aa1a2 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-80847d8e-3acc-4bfd-8ae6-f772c5212e2e for instance with vm_state building and task_state spawning.
Oct 26 15:55:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-ca4e1d8b-97cd-4389-ad34-7f6a290740c0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-ca4e1d8b-97cd-4389-ad34-7f6a290740c0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:56 user nova-compute[74646]: WARNING nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-ca4e1d8b-97cd-4389-ad34-7f6a290740c0 for instance with vm_state building and task_state spawning.
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-25359995-da39-408c-85d6-7f9b16b8c3f9 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-25359995-da39-408c-85d6-7f9b16b8c3f9 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:56 user nova-compute[74646]: WARNING nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-25359995-da39-408c-85d6-7f9b16b8c3f9 for instance with vm_state building and task_state spawning.
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-25359995-da39-408c-85d6-7f9b16b8c3f9 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-25359995-da39-408c-85d6-7f9b16b8c3f9 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:56 user nova-compute[74646]: WARNING nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-25359995-da39-408c-85d6-7f9b16b8c3f9 for instance with vm_state building and task_state spawning.
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-22241012-3061-44ab-b747-14a46854c933 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-22241012-3061-44ab-b747-14a46854c933 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:56 user nova-compute[74646]: WARNING nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-22241012-3061-44ab-b747-14a46854c933 for instance with vm_state building and task_state spawning.
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-22241012-3061-44ab-b747-14a46854c933 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-22241012-3061-44ab-b747-14a46854c933 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:55:56 user nova-compute[74646]: WARNING nova.compute.manager [req-3be99489-a9e2-4a40-9b04-e527adb5dc87 req-22461067-017d-483d-ab32-59f2f4517814 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-22241012-3061-44ab-b747-14a46854c933 for instance with vm_state building and task_state spawning.
Oct 26 15:55:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:55:58 user nova-compute[74646]: DEBUG nova.compute.manager [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:55:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:55:58 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Instance spawned successfully.
Oct 26 15:55:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:55:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:55:58 user nova-compute[74646]: INFO nova.compute.manager [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Took 11.93 seconds to spawn the instance on the hypervisor.
Oct 26 15:55:58 user nova-compute[74646]: DEBUG nova.compute.manager [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:55:58 user nova-compute[74646]: INFO nova.compute.manager [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Took 250.52 seconds to build instance.
Oct 26 15:55:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-378a8e24-2e38-4a9e-a480-6a0d860e5275 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 250.638s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:55:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 47.301s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:55:58 user nova-compute[74646]: INFO nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 26 15:55:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "65393333-197f-400e-89b5-7438f5697169" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "65393333-197f-400e-89b5-7438f5697169" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:00 user nova-compute[74646]: DEBUG nova.compute.manager [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:56:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:00 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:56:00 user nova-compute[74646]: INFO nova.compute.claims [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Claim successful on node user
Oct 26 15:56:01 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.376s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG nova.compute.manager [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG nova.compute.manager [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG nova.network.neutron [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:56:01 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:56:01 user nova-compute[74646]: DEBUG nova.compute.manager [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG nova.policy [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b57a8707539042deafe65215e10974eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94630fc764f54e5782d3551bfe65e882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG nova.compute.manager [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:56:01 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Creating image(s)
Oct 26 15:56:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "/opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "/opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "/opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.217s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.208s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk 1073741824" returned: 0 in 0.054s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG nova.network.neutron [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Successfully created port: bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.235s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Checking if we can resize image /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Cannot resize image /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Ensure instance console log exists: /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.network.neutron [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Successfully updated port: bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "refresh_cache-65393333-197f-400e-89b5-7438f5697169" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquired lock "refresh_cache-65393333-197f-400e-89b5-7438f5697169" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.network.neutron [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.compute.manager [req-45c16ecf-b670-42b9-9d64-ca33c9dec476 req-df65c2bc-3fcf-420f-bf55-8a830d710aed service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received event network-changed-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.compute.manager [req-45c16ecf-b670-42b9-9d64-ca33c9dec476 req-df65c2bc-3fcf-420f-bf55-8a830d710aed service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Refreshing instance network info cache due to event network-changed-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-45c16ecf-b670-42b9-9d64-ca33c9dec476 req-df65c2bc-3fcf-420f-bf55-8a830d710aed service nova] Acquiring lock "refresh_cache-65393333-197f-400e-89b5-7438f5697169" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.network.neutron [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.network.neutron [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Updating instance_info_cache with network_info: [{"id": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "address": "fa:16:3e:1c:80:7c", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba2fc0f-9e", "ovs_interfaceid": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Releasing lock "refresh_cache-65393333-197f-400e-89b5-7438f5697169" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.compute.manager [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Instance network_info: |[{"id": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "address": "fa:16:3e:1c:80:7c", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba2fc0f-9e", "ovs_interfaceid": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-45c16ecf-b670-42b9-9d64-ca33c9dec476 req-df65c2bc-3fcf-420f-bf55-8a830d710aed service nova] Acquired lock "refresh_cache-65393333-197f-400e-89b5-7438f5697169" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.network.neutron [req-45c16ecf-b670-42b9-9d64-ca33c9dec476 req-df65c2bc-3fcf-420f-bf55-8a830d710aed service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Refreshing network info cache for port bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Start _get_guest_xml network_info=[{"id": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "address": "fa:16:3e:1c:80:7c", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba2fc0f-9e", "ovs_interfaceid": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:56:03 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:56:03 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1633789750',display_name='tempest-VolumesSnapshotTestJSON-instance-1633789750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1633789750',id=17,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjmiEiGjQdnKXfo2EpC1M56jgxLw8Kgvc7t9WhsjCqXY02ufoxy3M2uO494Ai1rHpiLmQ49K1SejHgwqJ0qRBXYd78avDKvphOS95dD+bWYpuvL1Luu1SQV1gbezOjuQg==',key_name='tempest-keypair-1343682025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94630fc764f54e5782d3551bfe65e882',ramdisk_id='',reservation_id='r-vvl24ais',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1332594439',owner_user_name='tempest-VolumesSnapshotTestJSON-1332594439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:56:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b57a8707539042deafe65215e10974eb',uuid=65393333-197f-400e-89b5-7438f5697169,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "address": "fa:16:3e:1c:80:7c", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba2fc0f-9e", "ovs_interfaceid": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Converting VIF {"id": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "address": "fa:16:3e:1c:80:7c", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba2fc0f-9e", "ovs_interfaceid": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:80:7c,bridge_name='br-int',has_traffic_filtering=True,id=bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd,network=Network(a8f622c2-5f60-4987-ad67-fe6d77ba5a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba2fc0f-9e') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.objects.instance [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lazy-loading 'pci_devices' on Instance uuid 65393333-197f-400e-89b5-7438f5697169 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:56:03 user nova-compute[74646]:   <uuid>65393333-197f-400e-89b5-7438f5697169</uuid>
Oct 26 15:56:03 user nova-compute[74646]:   <name>instance-00000011</name>
Oct 26 15:56:03 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:56:03 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:56:03 user nova-compute[74646]:   <metadata>
Oct 26 15:56:03 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:56:03 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:56:03 user nova-compute[74646]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1633789750</nova:name>
Oct 26 15:56:03 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:56:03</nova:creationTime>
Oct 26 15:56:03 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:56:03 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:56:03 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:56:03 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:56:03 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:56:03 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:56:03 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:56:03 user nova-compute[74646]:       <nova:owner>
Oct 26 15:56:03 user nova-compute[74646]:         <nova:user uuid="b57a8707539042deafe65215e10974eb">tempest-VolumesSnapshotTestJSON-1332594439-project-member</nova:user>
Oct 26 15:56:03 user nova-compute[74646]:         <nova:project uuid="94630fc764f54e5782d3551bfe65e882">tempest-VolumesSnapshotTestJSON-1332594439</nova:project>
Oct 26 15:56:03 user nova-compute[74646]:       </nova:owner>
Oct 26 15:56:03 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:56:03 user nova-compute[74646]:       <nova:ports>
Oct 26 15:56:03 user nova-compute[74646]:         <nova:port uuid="bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd">
Oct 26 15:56:03 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 15:56:03 user nova-compute[74646]:         </nova:port>
Oct 26 15:56:03 user nova-compute[74646]:       </nova:ports>
Oct 26 15:56:03 user nova-compute[74646]:     </nova:instance>
Oct 26 15:56:03 user nova-compute[74646]:   </metadata>
Oct 26 15:56:03 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:56:03 user nova-compute[74646]:     <system>
Oct 26 15:56:03 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:56:03 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:56:03 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:56:03 user nova-compute[74646]:       <entry name="serial">65393333-197f-400e-89b5-7438f5697169</entry>
Oct 26 15:56:03 user nova-compute[74646]:       <entry name="uuid">65393333-197f-400e-89b5-7438f5697169</entry>
Oct 26 15:56:03 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:56:03 user nova-compute[74646]:     </system>
Oct 26 15:56:03 user nova-compute[74646]:   </sysinfo>
Oct 26 15:56:03 user nova-compute[74646]:   <os>
Oct 26 15:56:03 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:56:03 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:56:03 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:56:03 user nova-compute[74646]:   </os>
Oct 26 15:56:03 user nova-compute[74646]:   <features>
Oct 26 15:56:03 user nova-compute[74646]:     <acpi/>
Oct 26 15:56:03 user nova-compute[74646]:     <apic/>
Oct 26 15:56:03 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:56:03 user nova-compute[74646]:   </features>
Oct 26 15:56:03 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:56:03 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:56:03 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:56:03 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:56:03 user nova-compute[74646]:   </clock>
Oct 26 15:56:03 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:56:03 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:56:03 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:56:03 user nova-compute[74646]:   </cpu>
Oct 26 15:56:03 user nova-compute[74646]:   <devices>
Oct 26 15:56:03 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:56:03 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:56:03 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk"/>
Oct 26 15:56:03 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:56:03 user nova-compute[74646]:     </disk>
Oct 26 15:56:03 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:56:03 user nova-compute[74646]:       <mac address="fa:16:3e:1c:80:7c"/>
Oct 26 15:56:03 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:56:03 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:56:03 user nova-compute[74646]:       <target dev="tapbba2fc0f-9e"/>
Oct 26 15:56:03 user nova-compute[74646]:     </interface>
Oct 26 15:56:03 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:56:03 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/console.log" append="off"/>
Oct 26 15:56:03 user nova-compute[74646]:     </serial>
Oct 26 15:56:03 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:56:03 user nova-compute[74646]:     <video>
Oct 26 15:56:03 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:56:03 user nova-compute[74646]:     </video>
Oct 26 15:56:03 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:56:03 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:56:03 user nova-compute[74646]:     </rng>
Oct 26 15:56:03 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:56:03 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:56:03 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:56:03 user nova-compute[74646]:     </memballoon>
Oct 26 15:56:03 user nova-compute[74646]:   </devices>
Oct 26 15:56:03 user nova-compute[74646]: </domain>
Oct 26 15:56:03 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1633789750',display_name='tempest-VolumesSnapshotTestJSON-instance-1633789750',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1633789750',id=17,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjmiEiGjQdnKXfo2EpC1M56jgxLw8Kgvc7t9WhsjCqXY02ufoxy3M2uO494Ai1rHpiLmQ49K1SejHgwqJ0qRBXYd78avDKvphOS95dD+bWYpuvL1Luu1SQV1gbezOjuQg==',key_name='tempest-keypair-1343682025',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94630fc764f54e5782d3551bfe65e882',ramdisk_id='',reservation_id='r-vvl24ais',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1332594439',owner_user_name='tempest-VolumesSnapshotTestJSON-1332594439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:56:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b57a8707539042deafe65215e10974eb',uuid=65393333-197f-400e-89b5-7438f5697169,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "address": "fa:16:3e:1c:80:7c", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba2fc0f-9e", "ovs_interfaceid": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Converting VIF {"id": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "address": "fa:16:3e:1c:80:7c", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba2fc0f-9e", "ovs_interfaceid": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:80:7c,bridge_name='br-int',has_traffic_filtering=True,id=bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd,network=Network(a8f622c2-5f60-4987-ad67-fe6d77ba5a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba2fc0f-9e') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG os_vif [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:80:7c,bridge_name='br-int',has_traffic_filtering=True,id=bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd,network=Network(a8f622c2-5f60-4987-ad67-fe6d77ba5a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba2fc0f-9e') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd2e2ade8-de6e-5cda-8851-42db4e0c78e1', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbba2fc0f-9e, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbba2fc0f-9e, col_values=(('qos', UUID('2d0abbb0-626d-47fd-8a31-a7482c4bda7b')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbba2fc0f-9e, col_values=(('external_ids', {'iface-id': 'bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:80:7c', 'vm-uuid': '65393333-197f-400e-89b5-7438f5697169'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:03 user nova-compute[74646]: INFO os_vif [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:80:7c,bridge_name='br-int',has_traffic_filtering=True,id=bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd,network=Network(a8f622c2-5f60-4987-ad67-fe6d77ba5a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba2fc0f-9e')
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] No VIF found with MAC fa:16:3e:1c:80:7c, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.network.neutron [req-45c16ecf-b670-42b9-9d64-ca33c9dec476 req-df65c2bc-3fcf-420f-bf55-8a830d710aed service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Updated VIF entry in instance network info cache for port bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG nova.network.neutron [req-45c16ecf-b670-42b9-9d64-ca33c9dec476 req-df65c2bc-3fcf-420f-bf55-8a830d710aed service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Updating instance_info_cache with network_info: [{"id": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "address": "fa:16:3e:1c:80:7c", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba2fc0f-9e", "ovs_interfaceid": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:56:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-45c16ecf-b670-42b9-9d64-ca33c9dec476 req-df65c2bc-3fcf-420f-bf55-8a830d710aed service nova] Releasing lock "refresh_cache-65393333-197f-400e-89b5-7438f5697169" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:56:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-435bbfdf-182b-4645-b94a-a92fdda123c0 req-a9a5665f-3d2e-4422-9cac-a7585a57a760 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received event network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-435bbfdf-182b-4645-b94a-a92fdda123c0 req-a9a5665f-3d2e-4422-9cac-a7585a57a760 service nova] Acquiring lock "65393333-197f-400e-89b5-7438f5697169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-435bbfdf-182b-4645-b94a-a92fdda123c0 req-a9a5665f-3d2e-4422-9cac-a7585a57a760 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-435bbfdf-182b-4645-b94a-a92fdda123c0 req-a9a5665f-3d2e-4422-9cac-a7585a57a760 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-435bbfdf-182b-4645-b94a-a92fdda123c0 req-a9a5665f-3d2e-4422-9cac-a7585a57a760 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] No waiting events found dispatching network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:05 user nova-compute[74646]: WARNING nova.compute.manager [req-435bbfdf-182b-4645-b94a-a92fdda123c0 req-a9a5665f-3d2e-4422-9cac-a7585a57a760 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received unexpected event network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd for instance with vm_state building and task_state spawning.
Oct 26 15:56:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:07 user nova-compute[74646]: DEBUG nova.compute.manager [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:56:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:56:07 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 65393333-197f-400e-89b5-7438f5697169] Instance spawned successfully.
Oct 26 15:56:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:56:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:56:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:56:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:56:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:56:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:56:07 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:56:07 user nova-compute[74646]: DEBUG nova.compute.manager [req-8a33fdcf-86c2-4cc4-a375-104fa1963293 req-fa3d8024-35e6-4fbb-893d-33d87c03f330 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received event network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8a33fdcf-86c2-4cc4-a375-104fa1963293 req-fa3d8024-35e6-4fbb-893d-33d87c03f330 service nova] Acquiring lock "65393333-197f-400e-89b5-7438f5697169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8a33fdcf-86c2-4cc4-a375-104fa1963293 req-fa3d8024-35e6-4fbb-893d-33d87c03f330 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8a33fdcf-86c2-4cc4-a375-104fa1963293 req-fa3d8024-35e6-4fbb-893d-33d87c03f330 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:07 user nova-compute[74646]: DEBUG nova.compute.manager [req-8a33fdcf-86c2-4cc4-a375-104fa1963293 req-fa3d8024-35e6-4fbb-893d-33d87c03f330 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] No waiting events found dispatching network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:07 user nova-compute[74646]: WARNING nova.compute.manager [req-8a33fdcf-86c2-4cc4-a375-104fa1963293 req-fa3d8024-35e6-4fbb-893d-33d87c03f330 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received unexpected event network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd for instance with vm_state building and task_state spawning.
Oct 26 15:56:07 user nova-compute[74646]: INFO nova.compute.manager [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Took 6.04 seconds to spawn the instance on the hypervisor.
Oct 26 15:56:07 user nova-compute[74646]: DEBUG nova.compute.manager [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:56:07 user nova-compute[74646]: INFO nova.compute.manager [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Took 6.79 seconds to build instance.
Oct 26 15:56:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b55709e1-c0bf-4b76-8938-f96b2f5117eb tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "65393333-197f-400e-89b5-7438f5697169" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.947s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:13 user nova-compute[74646]: DEBUG nova.compute.manager [req-c9b3f935-074f-4390-9027-7ca442d88b35 req-7e6cd376-9f1a-468b-bde4-7dd87684c3f4 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received event network-changed-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:13 user nova-compute[74646]: DEBUG nova.compute.manager [req-c9b3f935-074f-4390-9027-7ca442d88b35 req-7e6cd376-9f1a-468b-bde4-7dd87684c3f4 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Refreshing instance network info cache due to event network-changed-ade5aae8-edfd-4f46-b943-e261afcc76f0. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:56:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c9b3f935-074f-4390-9027-7ca442d88b35 req-7e6cd376-9f1a-468b-bde4-7dd87684c3f4 service nova] Acquiring lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:56:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c9b3f935-074f-4390-9027-7ca442d88b35 req-7e6cd376-9f1a-468b-bde4-7dd87684c3f4 service nova] Acquired lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:56:13 user nova-compute[74646]: DEBUG nova.network.neutron [req-c9b3f935-074f-4390-9027-7ca442d88b35 req-7e6cd376-9f1a-468b-bde4-7dd87684c3f4 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Refreshing network info cache for port ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:56:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:13 user nova-compute[74646]: DEBUG nova.network.neutron [req-c9b3f935-074f-4390-9027-7ca442d88b35 req-7e6cd376-9f1a-468b-bde4-7dd87684c3f4 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updated VIF entry in instance network info cache for port ade5aae8-edfd-4f46-b943-e261afcc76f0. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:56:13 user nova-compute[74646]: DEBUG nova.network.neutron [req-c9b3f935-074f-4390-9027-7ca442d88b35 req-7e6cd376-9f1a-468b-bde4-7dd87684c3f4 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updating instance_info_cache with network_info: [{"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:56:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c9b3f935-074f-4390-9027-7ca442d88b35 req-7e6cd376-9f1a-468b-bde4-7dd87684c3f4 service nova] Releasing lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:56:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:16 user nova-compute[74646]: DEBUG nova.compute.manager [req-4a1e3b06-f30f-498b-8dcd-1b9763fd53a5 req-c7541595-7de6-4655-baf8-87084ac42f37 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-changed-95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:16 user nova-compute[74646]: DEBUG nova.compute.manager [req-4a1e3b06-f30f-498b-8dcd-1b9763fd53a5 req-c7541595-7de6-4655-baf8-87084ac42f37 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing instance network info cache due to event network-changed-95eb1246-2ee9-4a59-979b-79c153fd7d8d. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:56:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4a1e3b06-f30f-498b-8dcd-1b9763fd53a5 req-c7541595-7de6-4655-baf8-87084ac42f37 service nova] Acquiring lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:56:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4a1e3b06-f30f-498b-8dcd-1b9763fd53a5 req-c7541595-7de6-4655-baf8-87084ac42f37 service nova] Acquired lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:56:16 user nova-compute[74646]: DEBUG nova.network.neutron [req-4a1e3b06-f30f-498b-8dcd-1b9763fd53a5 req-c7541595-7de6-4655-baf8-87084ac42f37 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Refreshing network info cache for port 95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG nova.network.neutron [req-4a1e3b06-f30f-498b-8dcd-1b9763fd53a5 req-c7541595-7de6-4655-baf8-87084ac42f37 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updated VIF entry in instance network info cache for port 95eb1246-2ee9-4a59-979b-79c153fd7d8d. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG nova.network.neutron [req-4a1e3b06-f30f-498b-8dcd-1b9763fd53a5 req-c7541595-7de6-4655-baf8-87084ac42f37 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating instance_info_cache with network_info: [{"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cf56ceb-7a00-44df-8241-64aa699593d0", "address": "fa:16:3e:53:50:ad", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf56ceb-7a", "ovs_interfaceid": "0cf56ceb-7a00-44df-8241-64aa699593d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "address": "fa:16:3e:a9:06:78", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28218d89-be", "ovs_interfaceid": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4a1e3b06-f30f-498b-8dcd-1b9763fd53a5 req-c7541595-7de6-4655-baf8-87084ac42f37 service nova] Releasing lock "refresh_cache-ea252f48-c697-445e-bfc8-4a919b23aa83" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:19 user nova-compute[74646]: INFO nova.compute.manager [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Terminating instance
Oct 26 15:56:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-88f00756-7b9f-46bd-8674-4a1007a37b43 req-1117bc1e-254c-4fdb-9d52-473042233ad6 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-unplugged-95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-88f00756-7b9f-46bd-8674-4a1007a37b43 req-1117bc1e-254c-4fdb-9d52-473042233ad6 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-88f00756-7b9f-46bd-8674-4a1007a37b43 req-1117bc1e-254c-4fdb-9d52-473042233ad6 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-88f00756-7b9f-46bd-8674-4a1007a37b43 req-1117bc1e-254c-4fdb-9d52-473042233ad6 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-88f00756-7b9f-46bd-8674-4a1007a37b43 req-1117bc1e-254c-4fdb-9d52-473042233ad6 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-unplugged-95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-88f00756-7b9f-46bd-8674-4a1007a37b43 req-1117bc1e-254c-4fdb-9d52-473042233ad6 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-unplugged-95eb1246-2ee9-4a59-979b-79c153fd7d8d for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:56:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG nova.compute.manager [req-b26149a5-ae3c-4ada-8676-cb455af1d633 req-a0711981-8b99-44f6-a8ad-228def078101 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-unplugged-15047c00-6637-4474-8e2d-a8c0fa1f0e7b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b26149a5-ae3c-4ada-8676-cb455af1d633 req-a0711981-8b99-44f6-a8ad-228def078101 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b26149a5-ae3c-4ada-8676-cb455af1d633 req-a0711981-8b99-44f6-a8ad-228def078101 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b26149a5-ae3c-4ada-8676-cb455af1d633 req-a0711981-8b99-44f6-a8ad-228def078101 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG nova.compute.manager [req-b26149a5-ae3c-4ada-8676-cb455af1d633 req-a0711981-8b99-44f6-a8ad-228def078101 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-unplugged-15047c00-6637-4474-8e2d-a8c0fa1f0e7b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG nova.compute.manager [req-b26149a5-ae3c-4ada-8676-cb455af1d633 req-a0711981-8b99-44f6-a8ad-228def078101 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-unplugged-15047c00-6637-4474-8e2d-a8c0fa1f0e7b for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-75daeba5-6501-47ca-866a-433dcbeedc2d req-ae2366ee-3fee-4f96-aeb0-4d04dc447564 service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Received event network-changed-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-75daeba5-6501-47ca-866a-433dcbeedc2d req-ae2366ee-3fee-4f96-aeb0-4d04dc447564 service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Refreshing instance network info cache due to event network-changed-ff1d7189-1721-4f3b-9c25-2aa8f71d9577. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-75daeba5-6501-47ca-866a-433dcbeedc2d req-ae2366ee-3fee-4f96-aeb0-4d04dc447564 service nova] Acquiring lock "refresh_cache-5fbfcaaa-f050-473e-9e59-e48179a606e2" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-75daeba5-6501-47ca-866a-433dcbeedc2d req-ae2366ee-3fee-4f96-aeb0-4d04dc447564 service nova] Acquired lock "refresh_cache-5fbfcaaa-f050-473e-9e59-e48179a606e2" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG nova.network.neutron [req-75daeba5-6501-47ca-866a-433dcbeedc2d req-ae2366ee-3fee-4f96-aeb0-4d04dc447564 service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Refreshing network info cache for port ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:56:21 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Instance destroyed successfully.
Oct 26 15:56:21 user nova-compute[74646]: DEBUG nova.objects.instance [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lazy-loading 'resources' on Instance uuid ea252f48-c697-445e-bfc8-4a919b23aa83 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:56:21 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:56:21 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:56:21 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7641MB free_disk=25.65685272216797GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:43:11,bridge_name='br-int',has_traffic_filtering=True,id=95eb1246-2ee9-4a59-979b-79c153fd7d8d,network=Network(3a05da1f-beab-43d8-966d-f48048823b2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95eb1246-2e') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG os_vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:43:11,bridge_name='br-int',has_traffic_filtering=True,id=95eb1246-2ee9-4a59-979b-79c153fd7d8d,network=Network(3a05da1f-beab-43d8-966d-f48048823b2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95eb1246-2e') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95eb1246-2e, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:22 user nova-compute[74646]: WARNING nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-95eb1246-2ee9-4a59-979b-79c153fd7d8d for instance with vm_state active and task_state deleting.
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-unplugged-84740bfb-a2c6-47dd-81f6-1b8b447349d1 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-unplugged-84740bfb-a2c6-47dd-81f6-1b8b447349d1 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-unplugged-84740bfb-a2c6-47dd-81f6-1b8b447349d1 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-84740bfb-a2c6-47dd-81f6-1b8b447349d1 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-84740bfb-a2c6-47dd-81f6-1b8b447349d1 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:22 user nova-compute[74646]: WARNING nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-84740bfb-a2c6-47dd-81f6-1b8b447349d1 for instance with vm_state active and task_state deleting.
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-unplugged-0cf56ceb-7a00-44df-8241-64aa699593d0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-unplugged-0cf56ceb-7a00-44df-8241-64aa699593d0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-unplugged-0cf56ceb-7a00-44df-8241-64aa699593d0 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-0cf56ceb-7a00-44df-8241-64aa699593d0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-0cf56ceb-7a00-44df-8241-64aa699593d0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:22 user nova-compute[74646]: WARNING nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-0cf56ceb-7a00-44df-8241-64aa699593d0 for instance with vm_state active and task_state deleting.
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-unplugged-9d77193f-b6bb-4a85-9380-d46735e5232b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-unplugged-9d77193f-b6bb-4a85-9380-d46735e5232b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-unplugged-9d77193f-b6bb-4a85-9380-d46735e5232b for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-9d77193f-b6bb-4a85-9380-d46735e5232b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-9d77193f-b6bb-4a85-9380-d46735e5232b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:22 user nova-compute[74646]: WARNING nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-9d77193f-b6bb-4a85-9380-d46735e5232b for instance with vm_state active and task_state deleting.
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-unplugged-cbf3c1ca-d650-4636-938c-168459a271d8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-unplugged-cbf3c1ca-d650-4636-938c-168459a271d8 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c258f6a-b9eb-4105-9b5c-6128212c49d1 req-161d7331-b1ff-497e-bbfa-edfd71050d54 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-unplugged-cbf3c1ca-d650-4636-938c-168459a271d8 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f00401a3-2fb2-42a5-8be4-67e94e86370a) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1c5d5313-72f0-4f49-83b7-f277d5da4191 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance ea252f48-c697-445e-bfc8-4a919b23aa83 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2b514455-44b2-4115-bb13-38ba1713a263 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 96a71d00-27f0-4dbe-88cb-e6f296178e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 65393333-197f-400e-89b5-7438f5697169 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: INFO os_vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:43:11,bridge_name='br-int',has_traffic_filtering=True,id=95eb1246-2ee9-4a59-979b-79c153fd7d8d,network=Network(3a05da1f-beab-43d8-966d-f48048823b2c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95eb1246-2e')
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:74:e8,bridge_name='br-int',has_traffic_filtering=True,id=15047c00-6637-4474-8e2d-a8c0fa1f0e7b,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15047c00-66') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:74:e8,bridge_name='br-int',has_traffic_filtering=True,id=15047c00-6637-4474-8e2d-a8c0fa1f0e7b,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15047c00-66') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap15047c00-66, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=374ed3d3-3931-407c-91f6-46941f0f8ab9) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-f5f534c6-e969-4ea3-b50a-d649007fd10b req-1535d48f-dc3f-46ff-92e5-60e08d7b303c service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-15047c00-6637-4474-8e2d-a8c0fa1f0e7b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f5f534c6-e969-4ea3-b50a-d649007fd10b req-1535d48f-dc3f-46ff-92e5-60e08d7b303c service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f5f534c6-e969-4ea3-b50a-d649007fd10b req-1535d48f-dc3f-46ff-92e5-60e08d7b303c service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f5f534c6-e969-4ea3-b50a-d649007fd10b req-1535d48f-dc3f-46ff-92e5-60e08d7b303c service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-f5f534c6-e969-4ea3-b50a-d649007fd10b req-1535d48f-dc3f-46ff-92e5-60e08d7b303c service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-15047c00-6637-4474-8e2d-a8c0fa1f0e7b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:22 user nova-compute[74646]: WARNING nova.compute.manager [req-f5f534c6-e969-4ea3-b50a-d649007fd10b req-1535d48f-dc3f-46ff-92e5-60e08d7b303c service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-15047c00-6637-4474-8e2d-a8c0fa1f0e7b for instance with vm_state active and task_state deleting.
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: INFO os_vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:74:e8,bridge_name='br-int',has_traffic_filtering=True,id=15047c00-6637-4474-8e2d-a8c0fa1f0e7b,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap15047c00-66')
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:34:81:e3,bridge_name='br-int',has_traffic_filtering=True,id=84740bfb-a2c6-47dd-81f6-1b8b447349d1,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap84740bfb-a2') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:81:e3,bridge_name='br-int',has_traffic_filtering=True,id=84740bfb-a2c6-47dd-81f6-1b8b447349d1,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap84740bfb-a2') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84740bfb-a2, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d68cfcb-1a52-4f6a-bbd5-b69cf783bd24) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: INFO os_vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:34:81:e3,bridge_name='br-int',has_traffic_filtering=True,id=84740bfb-a2c6-47dd-81f6-1b8b447349d1,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap84740bfb-a2')
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cf56ceb-7a00-44df-8241-64aa699593d0", "address": "fa:16:3e:53:50:ad", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf56ceb-7a", "ovs_interfaceid": "0cf56ceb-7a00-44df-8241-64aa699593d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "0cf56ceb-7a00-44df-8241-64aa699593d0", "address": "fa:16:3e:53:50:ad", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf56ceb-7a", "ovs_interfaceid": "0cf56ceb-7a00-44df-8241-64aa699593d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:50:ad,bridge_name='br-int',has_traffic_filtering=True,id=0cf56ceb-7a00-44df-8241-64aa699593d0,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf56ceb-7a') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:50:ad,bridge_name='br-int',has_traffic_filtering=True,id=0cf56ceb-7a00-44df-8241-64aa699593d0,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf56ceb-7a') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cf56ceb-7a, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ffe8e83-3c1f-41aa-b164-43c835161e36) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.network.neutron [req-75daeba5-6501-47ca-866a-433dcbeedc2d req-ae2366ee-3fee-4f96-aeb0-4d04dc447564 service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Updated VIF entry in instance network info cache for port ff1d7189-1721-4f3b-9c25-2aa8f71d9577. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.network.neutron [req-75daeba5-6501-47ca-866a-433dcbeedc2d req-ae2366ee-3fee-4f96-aeb0-4d04dc447564 service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Updating instance_info_cache with network_info: [{"id": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "address": "fa:16:3e:10:ee:9c", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff1d7189-17", "ovs_interfaceid": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: INFO os_vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:50:ad,bridge_name='br-int',has_traffic_filtering=True,id=0cf56ceb-7a00-44df-8241-64aa699593d0,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf56ceb-7a')
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:fb:a2,bridge_name='br-int',has_traffic_filtering=True,id=9d77193f-b6bb-4a85-9380-d46735e5232b,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d77193f-b6') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:fb:a2,bridge_name='br-int',has_traffic_filtering=True,id=9d77193f-b6bb-4a85-9380-d46735e5232b,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d77193f-b6') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-75daeba5-6501-47ca-866a-433dcbeedc2d req-ae2366ee-3fee-4f96-aeb0-4d04dc447564 service nova] Releasing lock "refresh_cache-5fbfcaaa-f050-473e-9e59-e48179a606e2" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9d77193f-b6, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.619s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d42fc32b-2c80-4783-b16e-74d6269993d1) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: INFO os_vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:fb:a2,bridge_name='br-int',has_traffic_filtering=True,id=9d77193f-b6bb-4a85-9380-d46735e5232b,network=Network(68b1e4b0-84d3-4868-a85d-f67618833cd1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9d77193f-b6')
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:85:7e,bridge_name='br-int',has_traffic_filtering=True,id=cbf3c1ca-d650-4636-938c-168459a271d8,network=Network(cad5dbb8-3017-4e41-a074-277a6347f429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbf3c1ca-d6') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:85:7e,bridge_name='br-int',has_traffic_filtering=True,id=cbf3c1ca-d650-4636-938c-168459a271d8,network=Network(cad5dbb8-3017-4e41-a074-277a6347f429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbf3c1ca-d6') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbf3c1ca-d6, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2f9e32fa-0a56-4d34-baf7-109dbbae5e31) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: INFO os_vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:85:7e,bridge_name='br-int',has_traffic_filtering=True,id=cbf3c1ca-d650-4636-938c-168459a271d8,network=Network(cad5dbb8-3017-4e41-a074-277a6347f429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbf3c1ca-d6')
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-465139721',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-465139721',id=11,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDk1v4M2NhfNVIX4F0a5DsEjSIyCxhf8thJJm04z48ORDOfVWk5nm5fRcQ/kBqnXALGQO+vmPLI9sI82I2j2Fk6+L7QPDMQ1U7k0l/qYWlMYcI03HA4r7NFpYU7xt0QOPA==',key_name='tempest-keypair-1292853048',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0beca39b7190412597eb3a5b27a26a99',ramdisk_id='',reservation_id='r-r3324ovo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1766906406',owner_user_name='tempest-TaggedBootDevicesTest_v242-1766906406-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7df1f6464b92453296f2985cd77e95fe',uuid=ea252f48-c697-445e-bfc8-4a919b23aa83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "address": "fa:16:3e:a9:06:78", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28218d89-be", "ovs_interfaceid": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converting VIF {"id": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "address": "fa:16:3e:a9:06:78", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28218d89-be", "ovs_interfaceid": "28218d89-bed3-4eca-83fd-9fbbe8ddf7c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a9:06:78,bridge_name='br-int',has_traffic_filtering=True,id=28218d89-bed3-4eca-83fd-9fbbe8ddf7c9,network=Network(cad5dbb8-3017-4e41-a074-277a6347f429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28218d89-be') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:06:78,bridge_name='br-int',has_traffic_filtering=True,id=28218d89-bed3-4eca-83fd-9fbbe8ddf7c9,network=Network(cad5dbb8-3017-4e41-a074-277a6347f429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28218d89-be') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28218d89-be, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27bd7466-1329-444b-a6c7-3e178b097ebe) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:22 user nova-compute[74646]: INFO os_vif [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a9:06:78,bridge_name='br-int',has_traffic_filtering=True,id=28218d89-bed3-4eca-83fd-9fbbe8ddf7c9,network=Network(cad5dbb8-3017-4e41-a074-277a6347f429),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28218d89-be')
Oct 26 15:56:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qdtCcXvK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:56:22 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.036s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23fc00d-a8bf-444f-bae0-e2c79ea63dc8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:56:22 user nova-compute[74646]: No targets found.
Oct 26 15:56:22 user nova-compute[74646]: iSNS:
Oct 26 15:56:22 user nova-compute[74646]: No targets found.
Oct 26 15:56:22 user nova-compute[74646]: STATIC:
Oct 26 15:56:22 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8
Oct 26 15:56:22 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:22 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:22 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb
Oct 26 15:56:22 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:22 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:22 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b
Oct 26 15:56:22 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:22 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:22 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd
Oct 26 15:56:22 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:22 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:22 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae
Oct 26 15:56:22 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:22 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:22 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0
Oct 26 15:56:22 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:22 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:22 user nova-compute[74646]: FIRMWARE:
Oct 26 15:56:22 user nova-compute[74646]: No targets found.
Oct 26 15:56:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:56:22 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:56:22 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f845c16-efe8-42b3-b7e4-87802f698b39]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6223d8e-1a54-4467-bd2b-b2ace2f1b9e8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:56:22 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:56:22 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:56:22 user nova-compute[74646]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)
Oct 26 15:56:22 user nova-compute[74646]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)
Oct 26 15:56:22 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:56:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:56:22 user nova-compute[74646]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd (non-flash)
Oct 26 15:56:22 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:56:22 user nova-compute[74646]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)
Oct 26 15:56:22 user nova-compute[74646]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)
Oct 26 15:56:22 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:56:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e0379e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd'): ({'sdd'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Removing single pathed devices sdd {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0a7faf-9189-4797-90e9-b03326a18535]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a66dac-a7ae-439c-93ca-57e6ce846add]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Flushing IO for device /dev/sdd {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4310cfc-36c1-4949-b4cf-d5cd87abfb4f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7fe550-8439-4c58-829c-a5b784ed5605]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4486b2f0-2342-4958-b06d-c11bd970ff20]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0ad57a-22d4-49a8-92f5-84983e52a9ea]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd, portal: 172.16.0.220,3260]
Oct 26 15:56:22 user nova-compute[74646]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd, portal: 172.16.0.220,3260] successful.
Oct 26 15:56:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:67a3a413-6e2c-4467-a709-b564560091cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[713c4a70-b89b-426f-891b-e87756f95d85]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] <== disconnect_volume: return (381ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yrKbVPUh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:56:23 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa31bd1-6678-4a7c-bc1d-bea05bbdc297]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:56:23 user nova-compute[74646]: No targets found.
Oct 26 15:56:23 user nova-compute[74646]: iSNS:
Oct 26 15:56:23 user nova-compute[74646]: No targets found.
Oct 26 15:56:23 user nova-compute[74646]: STATIC:
Oct 26 15:56:23 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8
Oct 26 15:56:23 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:23 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:23 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb
Oct 26 15:56:23 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:23 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:23 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b
Oct 26 15:56:23 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:23 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:23 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae
Oct 26 15:56:23 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:23 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:23 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0
Oct 26 15:56:23 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:23 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:23 user nova-compute[74646]: FIRMWARE:
Oct 26 15:56:23 user nova-compute[74646]: No targets found.
Oct 26 15:56:23 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:56:23 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:56:23 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ec8356-f9a1-4411-9034-57e747e5a795]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cdd4ada-e736-4e49-97b8-d98dae03e398]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:56:23 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:56:23 user nova-compute[74646]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)
Oct 26 15:56:23 user nova-compute[74646]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)
Oct 26 15:56:23 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:56:23 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:56:23 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:56:23 user nova-compute[74646]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)
Oct 26 15:56:23 user nova-compute[74646]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)
Oct 26 15:56:23 user nova-compute[74646]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb (non-flash)
Oct 26 15:56:23 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d0468d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb'): ({'sdb'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Removing single pathed devices sdb {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[393d87a1-d062-42f4-85aa-7889215abcaf]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[805925e1-ac90-47a3-b6c7-1fab2e4b8756]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Flushing IO for device /dev/sdb {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bf21cd-9756-403f-a276-4bdcca9c6489]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e53bee53-bc58-439d-a2f1-fe878e212e02]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef69bf3-a352-47e5-812e-5f1a6e36e323]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --logout" returned: 0 in 0.097s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d392037-84ea-461a-890c-4ea5381687d4]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb, portal: 172.16.0.220,3260]
Oct 26 15:56:23 user nova-compute[74646]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb, portal: 172.16.0.220,3260] successful.
Oct 26 15:56:23 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8b515835-42e3-4304-ab91-13eb78f289eb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d30e2b3-1aaa-4358-b28b-89e2908d9dc8]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] <== disconnect_volume: return (368ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gBEJXVWm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:56:23 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df9de05-2d49-4150-aa96-7af6e2aac446]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:56:23 user nova-compute[74646]: No targets found.
Oct 26 15:56:23 user nova-compute[74646]: iSNS:
Oct 26 15:56:23 user nova-compute[74646]: No targets found.
Oct 26 15:56:23 user nova-compute[74646]: STATIC:
Oct 26 15:56:23 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8
Oct 26 15:56:23 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:23 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:23 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b
Oct 26 15:56:23 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:23 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:23 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae
Oct 26 15:56:23 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:23 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:23 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0
Oct 26 15:56:23 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:56:23 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:56:23 user nova-compute[74646]: FIRMWARE:
Oct 26 15:56:23 user nova-compute[74646]: No targets found.
Oct 26 15:56:23 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:56:23 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:56:23 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02a952c-8c14-46a3-b1ce-4746b589a93a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e1aa7e-5087-47b2-9c28-83c6700f1c85]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:56:23 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:56:23 user nova-compute[74646]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)
Oct 26 15:56:23 user nova-compute[74646]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)
Oct 26 15:56:23 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae (non-flash)
Oct 26 15:56:23 user nova-compute[74646]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:56:23 user nova-compute[74646]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)
Oct 26 15:56:23 user nova-compute[74646]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)
Oct 26 15:56:23 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d0468d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae'): ({'sdc'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Removing single pathed devices sdc {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc38fe80-dc87-45ee-827e-8af0c2192680]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Rebuilding the list of instances to heal {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a264d8db-99f3-42a7-ae81-9f021bc793c4]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Flushing IO for device /dev/sdc {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47d4c7a-f00d-481b-84e4-322bcb7d7867]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Skipping network cache update for instance because it is being deleted. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[783b950a-a0f7-4d03-9dbd-5de73a85af2d]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG nova.objects.instance [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lazy-loading 'info_cache' on Instance uuid 1c5d5313-72f0-4f49-83b7-f277d5da4191 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6ba53d-5f5d-4130-be23-00bbecd3ee4c]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b2ed3c-4c05-4b45-ad39-94278416c3aa]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae, portal: 172.16.0.220,3260]
Oct 26 15:56:23 user nova-compute[74646]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae, portal: 172.16.0.220,3260] successful.
Oct 26 15:56:23 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e89b4d1b-224d-4b00-b83c-1190338c8eae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f35ab1-abd1-46a9-a180-027b1fe33e52]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.336s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] <== disconnect_volume: return (338ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:56:23 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Deleting instance files /opt/stack/data/nova/instances/ea252f48-c697-445e-bfc8-4a919b23aa83_del
Oct 26 15:56:23 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Deletion of /opt/stack/data/nova/instances/ea252f48-c697-445e-bfc8-4a919b23aa83_del complete
Oct 26 15:56:23 user nova-compute[74646]: INFO nova.compute.manager [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Took 4.36 seconds to destroy the instance on the hypervisor.
Oct 26 15:56:23 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 15:56:23 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Updating instance_info_cache with network_info: [{"id": "529d94bf-3278-41ad-b2c1-522b68db2421", "address": "fa:16:3e:2e:e2:50", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529d94bf-32", "ovs_interfaceid": "529d94bf-3278-41ad-b2c1-522b68db2421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-1c5d5313-72f0-4f49-83b7-f277d5da4191" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG nova.compute.manager [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-cbf3c1ca-d650-4636-938c-168459a271d8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG nova.compute.manager [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-cbf3c1ca-d650-4636-938c-168459a271d8 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:24 user nova-compute[74646]: WARNING nova.compute.manager [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-cbf3c1ca-d650-4636-938c-168459a271d8 for instance with vm_state active and task_state deleting.
Oct 26 15:56:24 user nova-compute[74646]: DEBUG nova.compute.manager [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-unplugged-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG nova.compute.manager [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-unplugged-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG nova.compute.manager [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-unplugged-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG nova.compute.manager [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-plugged-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] Acquiring lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:24 user nova-compute[74646]: DEBUG nova.compute.manager [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] No waiting events found dispatching network-vif-plugged-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:56:24 user nova-compute[74646]: WARNING nova.compute.manager [req-b15e5ddf-4037-4aa8-95e1-7181c236be02 req-36891979-31d1-4bab-a254-3cc79f315474 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received unexpected event network-vif-plugged-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 for instance with vm_state active and task_state deleting.
Oct 26 15:56:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-a804df3a-1254-4873-bf2c-a524d06db84f req-3e8d5b9e-c830-4264-ae84-00ec24c52ae0 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-deleted-28218d89-bed3-4eca-83fd-9fbbe8ddf7c9 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:26 user nova-compute[74646]: INFO nova.compute.manager [req-a804df3a-1254-4873-bf2c-a524d06db84f req-3e8d5b9e-c830-4264-ae84-00ec24c52ae0 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Neutron deleted interface 28218d89-bed3-4eca-83fd-9fbbe8ddf7c9; detaching it from the instance and deleting it from the info cache
Oct 26 15:56:26 user nova-compute[74646]: DEBUG nova.network.neutron [req-a804df3a-1254-4873-bf2c-a524d06db84f req-3e8d5b9e-c830-4264-ae84-00ec24c52ae0 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating instance_info_cache with network_info: [{"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0cf56ceb-7a00-44df-8241-64aa699593d0", "address": "fa:16:3e:53:50:ad", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf56ceb-7a", "ovs_interfaceid": "0cf56ceb-7a00-44df-8241-64aa699593d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:56:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-a804df3a-1254-4873-bf2c-a524d06db84f req-3e8d5b9e-c830-4264-ae84-00ec24c52ae0 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Detach interface failed, port_id=28218d89-bed3-4eca-83fd-9fbbe8ddf7c9, reason: Instance ea252f48-c697-445e-bfc8-4a919b23aa83 could not be found. {{(pid=74646) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 15:56:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-a804df3a-1254-4873-bf2c-a524d06db84f req-3e8d5b9e-c830-4264-ae84-00ec24c52ae0 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-deleted-0cf56ceb-7a00-44df-8241-64aa699593d0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:26 user nova-compute[74646]: INFO nova.compute.manager [req-a804df3a-1254-4873-bf2c-a524d06db84f req-3e8d5b9e-c830-4264-ae84-00ec24c52ae0 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Neutron deleted interface 0cf56ceb-7a00-44df-8241-64aa699593d0; detaching it from the instance and deleting it from the info cache
Oct 26 15:56:26 user nova-compute[74646]: DEBUG nova.network.neutron [req-a804df3a-1254-4873-bf2c-a524d06db84f req-3e8d5b9e-c830-4264-ae84-00ec24c52ae0 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating instance_info_cache with network_info: [{"id": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "address": "fa:16:3e:30:43:11", "network": {"id": "3a05da1f-beab-43d8-966d-f48048823b2c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1469529543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95eb1246-2e", "ovs_interfaceid": "95eb1246-2ee9-4a59-979b-79c153fd7d8d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "address": "fa:16:3e:3d:74:e8", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.64", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap15047c00-66", "ovs_interfaceid": "15047c00-6637-4474-8e2d-a8c0fa1f0e7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "address": "fa:16:3e:34:81:e3", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84740bfb-a2", "ovs_interfaceid": "84740bfb-a2c6-47dd-81f6-1b8b447349d1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9d77193f-b6bb-4a85-9380-d46735e5232b", "address": "fa:16:3e:23:fb:a2", "network": {"id": "68b1e4b0-84d3-4868-a85d-f67618833cd1", "bridge": "br-int", "label": "tempest-device-tagging-net1-286689608", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.76", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9d77193f-b6", "ovs_interfaceid": "9d77193f-b6bb-4a85-9380-d46735e5232b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "cbf3c1ca-d650-4636-938c-168459a271d8", "address": "fa:16:3e:e9:85:7e", "network": {"id": "cad5dbb8-3017-4e41-a074-277a6347f429", "bridge": "br-int", "label": "tempest-device-tagging-net2-648751622", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "0beca39b7190412597eb3a5b27a26a99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbf3c1ca-d6", "ovs_interfaceid": "cbf3c1ca-d650-4636-938c-168459a271d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:56:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-a804df3a-1254-4873-bf2c-a524d06db84f req-3e8d5b9e-c830-4264-ae84-00ec24c52ae0 service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Detach interface failed, port_id=0cf56ceb-7a00-44df-8241-64aa699593d0, reason: Instance ea252f48-c697-445e-bfc8-4a919b23aa83 could not be found. {{(pid=74646) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG nova.objects.instance [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lazy-loading 'flavor' on Instance uuid 5fbfcaaa-f050-473e-9e59-e48179a606e2 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:27 user nova-compute[74646]: INFO nova.compute.manager [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Attaching volume 9003ceeb-4d8a-4e31-a41f-b5466741b45f to /dev/vdb
Oct 26 15:56:27 user nova-compute[74646]: DEBUG os_brick.utils [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[685cfbed-9bac-4138-b2c7-e5fac439c75c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc29a3a8-508f-4462-a3ec-1f1b56e4e692]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1926dc-b2b0-4d4a-89fc-840d0cf3cd42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5b14ea-8473-4523-b5af-c0c917118d1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:56:27 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:56:27 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dee3774-a954-4f63-943b-bf488856ba91]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG os_brick.utils [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Updating existing volume attachment record: dcf6d7fa-5a46-4efa-89a3-ef13b7de2486 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:56:27 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:56:27 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Took 4.03 seconds to deallocate network for instance.
Oct 26 15:56:28 user nova-compute[74646]: DEBUG nova.compute.manager [req-0b6fce18-572a-483d-9a6a-bd5bb74c7a22 req-4dd369ee-b35e-4db4-9426-e76be5c8b47e service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-deleted-9d77193f-b6bb-4a85-9380-d46735e5232b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:28 user nova-compute[74646]: DEBUG nova.compute.manager [req-0b6fce18-572a-483d-9a6a-bd5bb74c7a22 req-4dd369ee-b35e-4db4-9426-e76be5c8b47e service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-deleted-95eb1246-2ee9-4a59-979b-79c153fd7d8d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:28 user nova-compute[74646]: DEBUG nova.compute.manager [req-0b6fce18-572a-483d-9a6a-bd5bb74c7a22 req-4dd369ee-b35e-4db4-9426-e76be5c8b47e service nova] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Received event network-vif-deleted-cbf3c1ca-d650-4636-938c-168459a271d8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:30 user nova-compute[74646]: INFO nova.compute.manager [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] [instance: ea252f48-c697-445e-bfc8-4a919b23aa83] Took 2.86 seconds to detach 3 volumes for instance.
Oct 26 15:56:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:56:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:56:31 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:56:31 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:56:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:31 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Deleted allocations for instance ea252f48-c697-445e-bfc8-4a919b23aa83
Oct 26 15:56:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c8a37f75-b90a-41ac-a424-6981402370af tempest-TaggedBootDevicesTest_v242-1766906406 tempest-TaggedBootDevicesTest_v242-1766906406-project-member] Lock "ea252f48-c697-445e-bfc8-4a919b23aa83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.882s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:56:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:56:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 15:56:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 15:56:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 15:56:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:56:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-4483d99a-7963-4c8b-bf5a-192465425dc1 req-6dc27a92-84a8-4267-825e-6d2fa34b4088 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Received event network-changed-db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:56:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-4483d99a-7963-4c8b-bf5a-192465425dc1 req-6dc27a92-84a8-4267-825e-6d2fa34b4088 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Refreshing instance network info cache due to event network-changed-db3b9afe-9410-40a7-981e-cb59201a81b2. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:56:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4483d99a-7963-4c8b-bf5a-192465425dc1 req-6dc27a92-84a8-4267-825e-6d2fa34b4088 service nova] Acquiring lock "refresh_cache-2b514455-44b2-4115-bb13-38ba1713a263" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:56:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4483d99a-7963-4c8b-bf5a-192465425dc1 req-6dc27a92-84a8-4267-825e-6d2fa34b4088 service nova] Acquired lock "refresh_cache-2b514455-44b2-4115-bb13-38ba1713a263" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:56:59 user nova-compute[74646]: DEBUG nova.network.neutron [req-4483d99a-7963-4c8b-bf5a-192465425dc1 req-6dc27a92-84a8-4267-825e-6d2fa34b4088 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Refreshing network info cache for port db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:57:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-4483d99a-7963-4c8b-bf5a-192465425dc1 req-6dc27a92-84a8-4267-825e-6d2fa34b4088 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Updated VIF entry in instance network info cache for port db3b9afe-9410-40a7-981e-cb59201a81b2. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:57:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-4483d99a-7963-4c8b-bf5a-192465425dc1 req-6dc27a92-84a8-4267-825e-6d2fa34b4088 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Updating instance_info_cache with network_info: [{"id": "db3b9afe-9410-40a7-981e-cb59201a81b2", "address": "fa:16:3e:4a:fd:67", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3b9afe-94", "ovs_interfaceid": "db3b9afe-9410-40a7-981e-cb59201a81b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:57:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4483d99a-7963-4c8b-bf5a-192465425dc1 req-6dc27a92-84a8-4267-825e-6d2fa34b4088 service nova] Releasing lock "refresh_cache-2b514455-44b2-4115-bb13-38ba1713a263" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:57:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-53ece2c8-7f16-40f8-bf68-9cff4a2a247c req-755e808a-c5e6-4f7c-af5d-e2be3c056490 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-changed-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-53ece2c8-7f16-40f8-bf68-9cff4a2a247c req-755e808a-c5e6-4f7c-af5d-e2be3c056490 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing instance network info cache due to event network-changed-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:57:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-53ece2c8-7f16-40f8-bf68-9cff4a2a247c req-755e808a-c5e6-4f7c-af5d-e2be3c056490 service nova] Acquiring lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:57:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-53ece2c8-7f16-40f8-bf68-9cff4a2a247c req-755e808a-c5e6-4f7c-af5d-e2be3c056490 service nova] Acquired lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:57:02 user nova-compute[74646]: DEBUG nova.network.neutron [req-53ece2c8-7f16-40f8-bf68-9cff4a2a247c req-755e808a-c5e6-4f7c-af5d-e2be3c056490 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Refreshing network info cache for port d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:57:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:03 user nova-compute[74646]: DEBUG nova.network.neutron [req-53ece2c8-7f16-40f8-bf68-9cff4a2a247c req-755e808a-c5e6-4f7c-af5d-e2be3c056490 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updated VIF entry in instance network info cache for port d60a67d2-ef24-4bd3-a395-c9a4a6db73a2. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:57:03 user nova-compute[74646]: DEBUG nova.network.neutron [req-53ece2c8-7f16-40f8-bf68-9cff4a2a247c req-755e808a-c5e6-4f7c-af5d-e2be3c056490 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updating instance_info_cache with network_info: [{"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7b891259-d291-4d80-bac2-c269b053975d", "address": "fa:16:3e:8f:e1:3d", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b891259-d2", "ovs_interfaceid": "7b891259-d291-4d80-bac2-c269b053975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:57:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-53ece2c8-7f16-40f8-bf68-9cff4a2a247c req-755e808a-c5e6-4f7c-af5d-e2be3c056490 service nova] Releasing lock "refresh_cache-72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:57:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:05 user nova-compute[74646]: INFO nova.compute.manager [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Terminating instance
Oct 26 15:57:05 user nova-compute[74646]: DEBUG nova.compute.manager [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 15:57:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-9866aca6-1c0b-40fa-a6c8-f2e8ec67b706 req-491fc3e6-317a-449e-9f9a-476a4d1469be service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-unplugged-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9866aca6-1c0b-40fa-a6c8-f2e8ec67b706 req-491fc3e6-317a-449e-9f9a-476a4d1469be service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9866aca6-1c0b-40fa-a6c8-f2e8ec67b706 req-491fc3e6-317a-449e-9f9a-476a4d1469be service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9866aca6-1c0b-40fa-a6c8-f2e8ec67b706 req-491fc3e6-317a-449e-9f9a-476a4d1469be service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-9866aca6-1c0b-40fa-a6c8-f2e8ec67b706 req-491fc3e6-317a-449e-9f9a-476a4d1469be service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-unplugged-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-9866aca6-1c0b-40fa-a6c8-f2e8ec67b706 req-491fc3e6-317a-449e-9f9a-476a4d1469be service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-unplugged-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-101ab7b6-15e7-4be8-9c40-55438bde247a req-b87f4b45-7ebb-4c65-863d-d81c37d00cf7 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-unplugged-ca4e1d8b-97cd-4389-ad34-7f6a290740c0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-101ab7b6-15e7-4be8-9c40-55438bde247a req-b87f4b45-7ebb-4c65-863d-d81c37d00cf7 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-101ab7b6-15e7-4be8-9c40-55438bde247a req-b87f4b45-7ebb-4c65-863d-d81c37d00cf7 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-101ab7b6-15e7-4be8-9c40-55438bde247a req-b87f4b45-7ebb-4c65-863d-d81c37d00cf7 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-101ab7b6-15e7-4be8-9c40-55438bde247a req-b87f4b45-7ebb-4c65-863d-d81c37d00cf7 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-unplugged-ca4e1d8b-97cd-4389-ad34-7f6a290740c0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-101ab7b6-15e7-4be8-9c40-55438bde247a req-b87f4b45-7ebb-4c65-863d-d81c37d00cf7 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-unplugged-ca4e1d8b-97cd-4389-ad34-7f6a290740c0 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "2b514455-44b2-4115-bb13-38ba1713a263" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "2b514455-44b2-4115-bb13-38ba1713a263" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:07 user nova-compute[74646]: DEBUG nova.objects.instance [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lazy-loading 'flavor' on Instance uuid 2b514455-44b2-4115-bb13-38ba1713a263 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:57:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "2b514455-44b2-4115-bb13-38ba1713a263" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:08 user nova-compute[74646]: WARNING nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 for instance with vm_state active and task_state deleting.
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-unplugged-6e68929c-fcd8-41eb-b969-28df0d9a1b4e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-unplugged-6e68929c-fcd8-41eb-b969-28df0d9a1b4e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-unplugged-6e68929c-fcd8-41eb-b969-28df0d9a1b4e for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-6e68929c-fcd8-41eb-b969-28df0d9a1b4e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-6e68929c-fcd8-41eb-b969-28df0d9a1b4e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:08 user nova-compute[74646]: WARNING nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-6e68929c-fcd8-41eb-b969-28df0d9a1b4e for instance with vm_state active and task_state deleting.
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-unplugged-7b891259-d291-4d80-bac2-c269b053975d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-unplugged-7b891259-d291-4d80-bac2-c269b053975d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-unplugged-7b891259-d291-4d80-bac2-c269b053975d for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-7b891259-d291-4d80-bac2-c269b053975d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-7b891259-d291-4d80-bac2-c269b053975d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:08 user nova-compute[74646]: WARNING nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-7b891259-d291-4d80-bac2-c269b053975d for instance with vm_state active and task_state deleting.
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-unplugged-80847d8e-3acc-4bfd-8ae6-f772c5212e2e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-unplugged-80847d8e-3acc-4bfd-8ae6-f772c5212e2e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-957404ee-5106-4fa8-a99a-983c1e2cad90 req-820d28a5-9690-4def-930c-d58f339fddd5 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-unplugged-80847d8e-3acc-4bfd-8ae6-f772c5212e2e for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "2b514455-44b2-4115-bb13-38ba1713a263" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "2b514455-44b2-4115-bb13-38ba1713a263" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:08 user nova-compute[74646]: INFO nova.compute.manager [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Attaching volume b36d28eb-4c7b-421a-aa79-7a17e138ea2a to /dev/vdb
Oct 26 15:57:08 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Instance destroyed successfully.
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.objects.instance [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lazy-loading 'resources' on Instance uuid 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ff:d6:d5,bridge_name='br-int',has_traffic_filtering=True,id=d60a67d2-ef24-4bd3-a395-c9a4a6db73a2,network=Network(8ba36fd9-4d7e-4597-8695-d8a4d86f90b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60a67d2-ef') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG os_vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:d6:d5,bridge_name='br-int',has_traffic_filtering=True,id=d60a67d2-ef24-4bd3-a395-c9a4a6db73a2,network=Network(8ba36fd9-4d7e-4597-8695-d8a4d86f90b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60a67d2-ef') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd60a67d2-ef, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca15e81d-5fc4-42a2-8ec0-7ee0d6f2cdf9) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-ca4e1d8b-97cd-4389-ad34-7f6a290740c0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-ca4e1d8b-97cd-4389-ad34-7f6a290740c0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:08 user nova-compute[74646]: WARNING nova.compute.manager [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-ca4e1d8b-97cd-4389-ad34-7f6a290740c0 for instance with vm_state active and task_state deleting.
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-unplugged-25359995-da39-408c-85d6-7f9b16b8c3f9 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-unplugged-25359995-da39-408c-85d6-7f9b16b8c3f9 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-unplugged-25359995-da39-408c-85d6-7f9b16b8c3f9 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-25359995-da39-408c-85d6-7f9b16b8c3f9 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-25359995-da39-408c-85d6-7f9b16b8c3f9 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:08 user nova-compute[74646]: WARNING nova.compute.manager [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-25359995-da39-408c-85d6-7f9b16b8c3f9 for instance with vm_state active and task_state deleting.
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-unplugged-22241012-3061-44ab-b747-14a46854c933 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-unplugged-22241012-3061-44ab-b747-14a46854c933 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-aabe0a36-2393-4fec-b0a6-878c9de50116 req-c42c118b-5d6d-4c29-878a-2cd229d505c4 service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-unplugged-22241012-3061-44ab-b747-14a46854c933 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:57:08 user nova-compute[74646]: DEBUG os_brick.utils [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca362d1-7e3b-4ef7-b6c9-3ba7f4a97dbf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[76728e82-3ac8-4973-af0d-10c892edcafc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: INFO os_vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ff:d6:d5,bridge_name='br-int',has_traffic_filtering=True,id=d60a67d2-ef24-4bd3-a395-c9a4a6db73a2,network=Network(8ba36fd9-4d7e-4597-8695-d8a4d86f90b8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60a67d2-ef')
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:49:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca4e1d8b-97cd-4389-ad34-7f6a290740c0,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapca4e1d8b-97') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:49:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca4e1d8b-97cd-4389-ad34-7f6a290740c0,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapca4e1d8b-97') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca4e1d8b-97, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6781f7d-bd53-48fd-99f1-e143ebf8d4fd) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.066s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3498bab-36c9-41b9-b039-f4dfe22f9e2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9257d335-7d93-4855-a7b0-9953928279d8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:57:09 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[618b4c1b-9dab-452b-8704-28b425261598]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.utils [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] <== get_connector_properties: return (224ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Updating existing volume attachment record: 4feb7166-835b-4eb2-a247-88084d089d59 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:57:09 user nova-compute[74646]: INFO os_vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:49:e8,bridge_name='br-int',has_traffic_filtering=True,id=ca4e1d8b-97cd-4389-ad34-7f6a290740c0,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapca4e1d8b-97')
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ee:38,bridge_name='br-int',has_traffic_filtering=True,id=6e68929c-fcd8-41eb-b969-28df0d9a1b4e,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e68929c-fc') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ee:38,bridge_name='br-int',has_traffic_filtering=True,id=6e68929c-fcd8-41eb-b969-28df0d9a1b4e,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e68929c-fc') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6e68929c-fc, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1672253d-cb57-48ea-8353-8ff64119b8fa) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: INFO os_vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:ee:38,bridge_name='br-int',has_traffic_filtering=True,id=6e68929c-fcd8-41eb-b969-28df0d9a1b4e,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6e68929c-fc')
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b891259-d291-4d80-bac2-c269b053975d", "address": "fa:16:3e:8f:e1:3d", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b891259-d2", "ovs_interfaceid": "7b891259-d291-4d80-bac2-c269b053975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "7b891259-d291-4d80-bac2-c269b053975d", "address": "fa:16:3e:8f:e1:3d", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.151", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b891259-d2", "ovs_interfaceid": "7b891259-d291-4d80-bac2-c269b053975d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e1:3d,bridge_name='br-int',has_traffic_filtering=True,id=7b891259-d291-4d80-bac2-c269b053975d,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b891259-d2') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e1:3d,bridge_name='br-int',has_traffic_filtering=True,id=7b891259-d291-4d80-bac2-c269b053975d,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b891259-d2') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b891259-d2, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38085aa4-2d0b-4ed6-b648-f1105818a406) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: INFO os_vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:e1:3d,bridge_name='br-int',has_traffic_filtering=True,id=7b891259-d291-4d80-bac2-c269b053975d,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b891259-d2')
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:75:f7,bridge_name='br-int',has_traffic_filtering=True,id=80847d8e-3acc-4bfd-8ae6-f772c5212e2e,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80847d8e-3a') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:75:f7,bridge_name='br-int',has_traffic_filtering=True,id=80847d8e-3acc-4bfd-8ae6-f772c5212e2e,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80847d8e-3a') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80847d8e-3a, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9fbb8049-551b-40e4-9601-d615e57dd931) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: INFO os_vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:75:f7,bridge_name='br-int',has_traffic_filtering=True,id=80847d8e-3acc-4bfd-8ae6-f772c5212e2e,network=Network(59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80847d8e-3a')
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:6e,bridge_name='br-int',has_traffic_filtering=True,id=25359995-da39-408c-85d6-7f9b16b8c3f9,network=Network(8ceff406-3578-4a98-a333-474334644fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25359995-da') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:6e,bridge_name='br-int',has_traffic_filtering=True,id=25359995-da39-408c-85d6-7f9b16b8c3f9,network=Network(8ceff406-3578-4a98-a333-474334644fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25359995-da') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25359995-da, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6f6db8fc-c8ad-4152-8fa0-9e30b6658e46) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: INFO os_vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:8d:6e,bridge_name='br-int',has_traffic_filtering=True,id=25359995-da39-408c-85d6-7f9b16b8c3f9,network=Network(8ceff406-3578-4a98-a333-474334644fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25359995-da')
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-26T15:51:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-79914725',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-79914725',id=10,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFvOTvtN/2oxLvQXBuM8Mhxi6RsNikaPx85xXGj0ACJkLCZAJ0Rb9I/NDERJg9/IvGKZKQqvHKSOm7UbeVVkDo1Je8SoehN/F6DiD9sdPOWfgdS7uT4yQGFSgwul65T05w==',key_name='tempest-keypair-964264077',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dd31de955f0540b89ca2d4bcaaf5746e',ramdisk_id='',reservation_id='r-a6ecwo01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-414809244',owner_user_name='tempest-TaggedBootDevicesTest-414809244-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0e35d67fdc0e46b098e239342ef9e506',uuid=72c080e8-7d97-41c2-8dc3-4e70dab3b9d7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converting VIF {"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c8:65:36,bridge_name='br-int',has_traffic_filtering=True,id=22241012-3061-44ab-b747-14a46854c933,network=Network(8ceff406-3578-4a98-a333-474334644fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22241012-30') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:65:36,bridge_name='br-int',has_traffic_filtering=True,id=22241012-3061-44ab-b747-14a46854c933,network=Network(8ceff406-3578-4a98-a333-474334644fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22241012-30') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22241012-30, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2972c95-5579-4f79-9f45-747b39dcbea0) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:09 user nova-compute[74646]: INFO os_vif [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c8:65:36,bridge_name='br-int',has_traffic_filtering=True,id=22241012-3061-44ab-b747-14a46854c933,network=Network(8ceff406-3578-4a98-a333-474334644fe6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap22241012-30')
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SBWuzNUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:57:09 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcd16f0-c413-4681-9b98-6461a3176d7d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:57:09 user nova-compute[74646]: No targets found.
Oct 26 15:57:09 user nova-compute[74646]: iSNS:
Oct 26 15:57:09 user nova-compute[74646]: No targets found.
Oct 26 15:57:09 user nova-compute[74646]: STATIC:
Oct 26 15:57:09 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8
Oct 26 15:57:09 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:57:09 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:57:09 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3
Oct 26 15:57:09 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:57:09 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:57:09 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b
Oct 26 15:57:09 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:57:09 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:57:09 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0
Oct 26 15:57:09 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:57:09 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:57:09 user nova-compute[74646]: FIRMWARE:
Oct 26 15:57:09 user nova-compute[74646]: No targets found.
Oct 26 15:57:09 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:57:09 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:57:09 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[269be9a3-2e14-42f5-9b0d-cfd69467d3da]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9100aa7a-a5ab-4cd6-abeb-6d1c975aaf01]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:57:09 user nova-compute[74646]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)
Oct 26 15:57:09 user nova-compute[74646]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)
Oct 26 15:57:09 user nova-compute[74646]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3 (non-flash)
Oct 26 15:57:09 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:57:09 user nova-compute[74646]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 (non-flash)
Oct 26 15:57:09 user nova-compute[74646]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)
Oct 26 15:57:09 user nova-compute[74646]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3 (non-flash)
Oct 26 15:57:09 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d0484e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8'): ({'sdf'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Removing single pathed devices sdf {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fef9f3-8765-46d8-9755-a6fdae061e5e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8503cf7-4b9e-487d-afb0-f07c216bb6a3]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Flushing IO for device /dev/sdf {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[085be505-33c8-474f-82e1-bd573116a63c]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.063s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[926cf089-c08c-4f8a-973c-788a4e3a5227]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] SCSI volumes sdf have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1879f3cf-6370-49b6-b5a9-7cd143a4b9c3]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e3b189-c843-4d08-9b54-32f66f4e5145]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8, portal: 172.16.0.220,3260]
Oct 26 15:57:09 user nova-compute[74646]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8, portal: 172.16.0.220,3260] successful.
Oct 26 15:57:09 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8cb56e7e-52ac-42eb-ba50-23f42b33acb8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb17b4ec-9db3-4512-9838-09998ccf96ad]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] <== disconnect_volume: return (354ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CSWBxewp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:57:09 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[897769d3-b203-470f-bf90-f79506a9e931]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:57:09 user nova-compute[74646]: No targets found.
Oct 26 15:57:09 user nova-compute[74646]: iSNS:
Oct 26 15:57:09 user nova-compute[74646]: No targets found.
Oct 26 15:57:09 user nova-compute[74646]: STATIC:
Oct 26 15:57:09 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3
Oct 26 15:57:09 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:57:09 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:57:09 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b
Oct 26 15:57:09 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:57:09 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:57:09 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0
Oct 26 15:57:09 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:57:09 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:57:09 user nova-compute[74646]: FIRMWARE:
Oct 26 15:57:09 user nova-compute[74646]: No targets found.
Oct 26 15:57:09 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:57:09 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:57:09 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1358307-181e-4b04-950b-bd034f2202f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8101ace-43f1-45bc-89b0-31ba0bdab4a6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:57:09 user nova-compute[74646]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)
Oct 26 15:57:09 user nova-compute[74646]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3 (non-flash)
Oct 26 15:57:09 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 (non-flash)
Oct 26 15:57:09 user nova-compute[74646]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)
Oct 26 15:57:09 user nova-compute[74646]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3 (non-flash)
Oct 26 15:57:09 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e8255e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0'): ({'sde'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Removing single pathed devices sde {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:57:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce27115a-23b7-42e1-ace8-e69bff1c66a8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e360a-ea1f-4b78-8872-e7df4b446a4e]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Flushing IO for device /dev/sde {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[def336d1-7da4-4e98-b5cf-4a44df0c6b6c]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d68dd4f5-1b76-4277-888e-77372b66339f]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] SCSI volumes sde have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0d0dda-d325-4b8c-bfcc-b06048d497ea]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1871f8a3-ff8f-4ca4-a6e3-97b78f5494a5]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0, portal: 172.16.0.220,3260]
Oct 26 15:57:10 user nova-compute[74646]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0, portal: 172.16.0.220,3260] successful.
Oct 26 15:57:10 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2de8e96-f8c2-43e4-b543-ed3e9349e2e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cce336-eafe-4fb6-8eaa-719bdff7e1bc]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] <== disconnect_volume: return (391ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpqUSIPC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:57:10 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bff1767-9c9a-4359-b630-c92b1d52cae7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:57:10 user nova-compute[74646]: No targets found.
Oct 26 15:57:10 user nova-compute[74646]: iSNS:
Oct 26 15:57:10 user nova-compute[74646]: No targets found.
Oct 26 15:57:10 user nova-compute[74646]: STATIC:
Oct 26 15:57:10 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3
Oct 26 15:57:10 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:57:10 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:57:10 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b
Oct 26 15:57:10 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:57:10 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:57:10 user nova-compute[74646]: FIRMWARE:
Oct 26 15:57:10 user nova-compute[74646]: No targets found.
Oct 26 15:57:10 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:57:10 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:57:10 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a760b3a-05a3-41a6-8c08-0fd5ca3f6665]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3988e524-d8ca-4c0d-968c-6e8749040b94]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)
Oct 26 15:57:10 user nova-compute[74646]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3 (non-flash)
Oct 26 15:57:10 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b (non-flash)
Oct 26 15:57:10 user nova-compute[74646]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b77ece1e-9092-4826-a918-6a63be7a0ac3 (non-flash)
Oct 26 15:57:10 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e8255e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b'): ({'sdg'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Removing single pathed devices sdg {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b244a9d4-4b37-42d9-8685-34c45a06521f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1c0071-c278-4e1a-9e5b-dcaf4b80ef06]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Flushing IO for device /dev/sdg {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03cd85d-8020-4f47-8b5a-269cebcc3190]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95146cc-3ced-4b25-aff2-3ef89a808d97]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] SCSI volumes sdg have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[da435ed1-07e0-42a0-8c41-0ab8dc42064d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd078351-e3cf-4de2-b86a-ede353e762cf]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b, portal: 172.16.0.220,3260]
Oct 26 15:57:10 user nova-compute[74646]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b, portal: 172.16.0.220,3260] successful.
Oct 26 15:57:10 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c85cc118-93ba-4153-abde-48c41d13909b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ecb892-8a48-4c86-9df6-a31ba7d194a9]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] <== disconnect_volume: return (314ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:57:10 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Deleting instance files /opt/stack/data/nova/instances/72c080e8-7d97-41c2-8dc3-4e70dab3b9d7_del
Oct 26 15:57:10 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Deletion of /opt/stack/data/nova/instances/72c080e8-7d97-41c2-8dc3-4e70dab3b9d7_del complete
Oct 26 15:57:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-3c3fa2cc-eea0-41ef-b377-a60ff8ac3c81 req-7cf3a2d7-bbae-4cfc-8f8f-86f3cff86d5c service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-80847d8e-3acc-4bfd-8ae6-f772c5212e2e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3c3fa2cc-eea0-41ef-b377-a60ff8ac3c81 req-7cf3a2d7-bbae-4cfc-8f8f-86f3cff86d5c service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3c3fa2cc-eea0-41ef-b377-a60ff8ac3c81 req-7cf3a2d7-bbae-4cfc-8f8f-86f3cff86d5c service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3c3fa2cc-eea0-41ef-b377-a60ff8ac3c81 req-7cf3a2d7-bbae-4cfc-8f8f-86f3cff86d5c service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-3c3fa2cc-eea0-41ef-b377-a60ff8ac3c81 req-7cf3a2d7-bbae-4cfc-8f8f-86f3cff86d5c service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-80847d8e-3acc-4bfd-8ae6-f772c5212e2e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:10 user nova-compute[74646]: WARNING nova.compute.manager [req-3c3fa2cc-eea0-41ef-b377-a60ff8ac3c81 req-7cf3a2d7-bbae-4cfc-8f8f-86f3cff86d5c service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-80847d8e-3acc-4bfd-8ae6-f772c5212e2e for instance with vm_state active and task_state deleting.
Oct 26 15:57:10 user nova-compute[74646]: INFO nova.compute.manager [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Took 5.01 seconds to destroy the instance on the hypervisor.
Oct 26 15:57:10 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 15:57:10 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 15:57:11 user nova-compute[74646]: DEBUG nova.compute.manager [req-7cd433e9-b6bb-46ad-893c-b108611c1fef req-01563933-6131-4d89-90d4-0eac57ddda1f service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-plugged-22241012-3061-44ab-b747-14a46854c933 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7cd433e9-b6bb-46ad-893c-b108611c1fef req-01563933-6131-4d89-90d4-0eac57ddda1f service nova] Acquiring lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7cd433e9-b6bb-46ad-893c-b108611c1fef req-01563933-6131-4d89-90d4-0eac57ddda1f service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7cd433e9-b6bb-46ad-893c-b108611c1fef req-01563933-6131-4d89-90d4-0eac57ddda1f service nova] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:11 user nova-compute[74646]: DEBUG nova.compute.manager [req-7cd433e9-b6bb-46ad-893c-b108611c1fef req-01563933-6131-4d89-90d4-0eac57ddda1f service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] No waiting events found dispatching network-vif-plugged-22241012-3061-44ab-b747-14a46854c933 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:11 user nova-compute[74646]: WARNING nova.compute.manager [req-7cd433e9-b6bb-46ad-893c-b108611c1fef req-01563933-6131-4d89-90d4-0eac57ddda1f service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received unexpected event network-vif-plugged-22241012-3061-44ab-b747-14a46854c933 for instance with vm_state active and task_state deleting.
Oct 26 15:57:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-a0d5cea4-e8b8-4a88-ab73-28b1e5bbbddc req-fbe6c443-8508-4aae-8953-b769d408824c service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-deleted-7b891259-d291-4d80-bac2-c269b053975d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:12 user nova-compute[74646]: INFO nova.compute.manager [req-a0d5cea4-e8b8-4a88-ab73-28b1e5bbbddc req-fbe6c443-8508-4aae-8953-b769d408824c service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Neutron deleted interface 7b891259-d291-4d80-bac2-c269b053975d; detaching it from the instance and deleting it from the info cache
Oct 26 15:57:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-a0d5cea4-e8b8-4a88-ab73-28b1e5bbbddc req-fbe6c443-8508-4aae-8953-b769d408824c service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updating instance_info_cache with network_info: [{"id": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "address": "fa:16:3e:ff:d6:d5", "network": {"id": "8ba36fd9-4d7e-4597-8695-d8a4d86f90b8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1360053739-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60a67d2-ef", "ovs_interfaceid": "d60a67d2-ef24-4bd3-a395-c9a4a6db73a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "address": "fa:16:3e:cd:49:e8", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca4e1d8b-97", "ovs_interfaceid": "ca4e1d8b-97cd-4389-ad34-7f6a290740c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "address": "fa:16:3e:cf:ee:38", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.129", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6e68929c-fc", "ovs_interfaceid": "6e68929c-fcd8-41eb-b969-28df0d9a1b4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "address": "fa:16:3e:21:75:f7", "network": {"id": "59e06b75-fe6e-4c7e-a1bb-e45e0176dfbe", "bridge": "br-int", "label": "tempest-device-tagging-net1-2092816524", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.157", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80847d8e-3a", "ovs_interfaceid": "80847d8e-3acc-4bfd-8ae6-f772c5212e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25359995-da39-408c-85d6-7f9b16b8c3f9", "address": "fa:16:3e:11:8d:6e", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25359995-da", "ovs_interfaceid": "25359995-da39-408c-85d6-7f9b16b8c3f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "22241012-3061-44ab-b747-14a46854c933", "address": "fa:16:3e:c8:65:36", "network": {"id": "8ceff406-3578-4a98-a333-474334644fe6", "bridge": "br-int", "label": "tempest-device-tagging-net2-1581330288", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "dd31de955f0540b89ca2d4bcaaf5746e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22241012-30", "ovs_interfaceid": "22241012-3061-44ab-b747-14a46854c933", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:57:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-a0d5cea4-e8b8-4a88-ab73-28b1e5bbbddc req-fbe6c443-8508-4aae-8953-b769d408824c service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Detach interface failed, port_id=7b891259-d291-4d80-bac2-c269b053975d, reason: Instance 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7 could not be found. {{(pid=74646) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 15:57:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:14 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:57:14 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Took 3.92 seconds to deallocate network for instance.
Oct 26 15:57:14 user nova-compute[74646]: DEBUG nova.compute.manager [req-acd9a2e2-0a65-4952-9fa7-22a919e8795e req-fbfa3fc6-430a-4788-8867-afc5e81e5b2a service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-deleted-80847d8e-3acc-4bfd-8ae6-f772c5212e2e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:14 user nova-compute[74646]: DEBUG nova.compute.manager [req-acd9a2e2-0a65-4952-9fa7-22a919e8795e req-fbfa3fc6-430a-4788-8867-afc5e81e5b2a service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-deleted-22241012-3061-44ab-b747-14a46854c933 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:14 user nova-compute[74646]: DEBUG nova.compute.manager [req-acd9a2e2-0a65-4952-9fa7-22a919e8795e req-fbfa3fc6-430a-4788-8867-afc5e81e5b2a service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-deleted-d60a67d2-ef24-4bd3-a395-c9a4a6db73a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:14 user nova-compute[74646]: DEBUG nova.compute.manager [req-acd9a2e2-0a65-4952-9fa7-22a919e8795e req-fbfa3fc6-430a-4788-8867-afc5e81e5b2a service nova] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Received event network-vif-deleted-25359995-da39-408c-85d6-7f9b16b8c3f9 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIEJGKoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:57:15 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:57:15 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:57:15 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59dcbb3-35a9-48af-9f00-a546e74d81e4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:57:15 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a67d10-19c7-4971-8843-8043859d352f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f] added
Oct 26 15:57:15 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[46355998-89c7-45fa-b56c-3d861dd6b8d2]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7e4c9f-0b8c-4e84-a786-af2039085566]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XIEJGKoF {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XIEJGKoF" returned: 0 in 0.031s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bc54fa-e72e-4684-9cba-6efe7da775cf]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XIEJGKoF'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.127s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb64db1a-2dd6-4ff7-acdb-65c9aac55a89]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[443df03b-5a19-4284-9b08-0f5ff3a5d8c5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 15:57:15 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 15:57:15 user nova-compute[74646]:  {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:57:15 user nova-compute[74646]: WARNING os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 15:57:15 user nova-compute[74646]: 
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[37021f47-b0ed-422c-83f7-ed6a92fa1a92]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f, portal: 172.16.0.220,3260]
Oct 26 15:57:15 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f, portal: 172.16.0.220,3260] successful.
Oct 26 15:57:15 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd1a4c1e-d43d-4299-82b3-ea1a5b628343]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[232d7fb1-15b3-426b-89b7-3a4110c33e47]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)
Oct 26 15:57:15 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)
Oct 26 15:57:15 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.435s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:57:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fbd8f2-8ebf-4713-9418-eaba0e559475]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:16 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:57:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIEJGKoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:57:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.473s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:57:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] <== connect_volume: return (1475ms) {'type': 'block', 'scsi_wwn': '26638326237313038', 'path': '/dev/sdb'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:57:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26638326237313038', 'path': '/dev/sdb'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:57:17 user nova-compute[74646]: DEBUG nova.objects.instance [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lazy-loading 'flavor' on Instance uuid 5fbfcaaa-f050-473e-9e59-e48179a606e2 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:57:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 15:57:17 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:57:17 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 15:57:17 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:57:17 user nova-compute[74646]:   <serial>9003ceeb-4d8a-4e31-a41f-b5466741b45f</serial>
Oct 26 15:57:17 user nova-compute[74646]: </disk>
Oct 26 15:57:17 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 15:57:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:57:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:57:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] No VIF found with MAC fa:16:3e:10:ee:9c, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:57:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-767f9380-4fac-411c-ba79-6dbb26ffbf20 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 50.311s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:57:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:57:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:57:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:57:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:57:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:57:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:19 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:57:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:57:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:22 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:57:22 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:57:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8024MB free_disk=25.60711669921875GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:57:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1c5d5313-72f0-4f49-83b7-f277d5da4191 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:57:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:57:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:57:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:57:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2b514455-44b2-4115-bb13-38ba1713a263 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:57:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 96a71d00-27f0-4dbe-88cb-e6f296178e90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:57:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 65393333-197f-400e-89b5-7438f5697169 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:57:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:57:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:57:23 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:57:23 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:57:23 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:57:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:57:24 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:57:24 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Skipping network cache update for instance because it is being deleted. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 26 15:57:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:57:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:57:24 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 15:57:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updating instance_info_cache with network_info: [{"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG nova.objects.instance [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lazy-loading 'flavor' on Instance uuid 5fbfcaaa-f050-473e-9e59-e48179a606e2 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:25 user nova-compute[74646]: INFO nova.compute.manager [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Attaching volume f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 to /dev/vdc
Oct 26 15:57:25 user nova-compute[74646]: DEBUG os_brick.utils [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[040e4932-8a09-433a-854b-c6e01ed841d5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5907785f-6881-4eff-9f7a-c1eff8aa8b35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[944ed568-a0b7-4d5b-95e2-f8dda6003e1f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[447c1323-92bf-4bbc-9a13-9c4034e1301b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:57:25 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:57:25 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f15163-a576-4c08-930a-08302bd7170f]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG os_brick.utils [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:57:25 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Updating existing volume attachment record: b5bc2d17-2648-4958-b452-39aa62bd4ec0 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:57:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDvlTEXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:57:31 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:57:31 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:57:31 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3738e04-0f52-4112-896e-cda09a1b1e4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:57:31 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f2908f-8d31-4736-9e59-79343a732449]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a] added
Oct 26 15:57:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a66182a-6cab-4523-b276-ecfd62d9fe98]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fab0d617-36d5-48b6-8ebc-8c6a2286fd95]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDvlTEXN {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cDvlTEXN" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[945f8c00-da6b-4dee-b618-1cb5134410db]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cDvlTEXN'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c6172b-53a6-4fcc-bc7c-d7173b329b93]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3ab837-08c9-4143-a627-d7b00f4874a7]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)
Oct 26 15:57:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)
Oct 26 15:57:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[da10ebc5-c0a3-417a-8a1d-594e84dc9b69]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a, portal: 172.16.0.220,3260]
Oct 26 15:57:31 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a, portal: 172.16.0.220,3260] successful.
Oct 26 15:57:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f841c31-5511-45f2-bc36-f986a3f07483]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[73a24246-b417-480c-a29a-69890e76a7a0]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)
Oct 26 15:57:31 user nova-compute[74646]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a (non-flash)
Oct 26 15:57:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)
Oct 26 15:57:31 user nova-compute[74646]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a (non-flash)
Oct 26 15:57:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf5a9dd-cc0b-4272-8cc0-32c1bc643563]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:57:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDvlTEXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:57:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:57:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] <== connect_volume: return (1383ms) {'type': 'block', 'scsi_wwn': '23732666165616538', 'path': '/dev/sdc'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:57:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732666165616538', 'path': '/dev/sdc'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:57:32 user nova-compute[74646]: DEBUG nova.objects.instance [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lazy-loading 'flavor' on Instance uuid 2b514455-44b2-4115-bb13-38ba1713a263 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:57:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 15:57:32 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:57:32 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 15:57:32 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:57:32 user nova-compute[74646]:   <serial>b36d28eb-4c7b-421a-aa79-7a17e138ea2a</serial>
Oct 26 15:57:32 user nova-compute[74646]: </disk>
Oct 26 15:57:32 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 15:57:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-b796bc6f-3234-4421-9c05-f2e9b897d24d req-80b4510b-485e-4b25-b95d-3bc4a6e92f36 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-changed-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-b796bc6f-3234-4421-9c05-f2e9b897d24d req-80b4510b-485e-4b25-b95d-3bc4a6e92f36 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Refreshing instance network info cache due to event network-changed-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:57:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b796bc6f-3234-4421-9c05-f2e9b897d24d req-80b4510b-485e-4b25-b95d-3bc4a6e92f36 service nova] Acquiring lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:57:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b796bc6f-3234-4421-9c05-f2e9b897d24d req-80b4510b-485e-4b25-b95d-3bc4a6e92f36 service nova] Acquired lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:57:32 user nova-compute[74646]: DEBUG nova.network.neutron [req-b796bc6f-3234-4421-9c05-f2e9b897d24d req-80b4510b-485e-4b25-b95d-3bc4a6e92f36 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Refreshing network info cache for port 3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:57:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:57:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:57:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] No VIF found with MAC fa:16:3e:4a:fd:67, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:57:33 user nova-compute[74646]: DEBUG nova.network.neutron [req-b796bc6f-3234-4421-9c05-f2e9b897d24d req-80b4510b-485e-4b25-b95d-3bc4a6e92f36 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updated VIF entry in instance network info cache for port 3e16bb7b-c1c2-4a11-aad9-2da2fbae632b. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:57:33 user nova-compute[74646]: DEBUG nova.network.neutron [req-b796bc6f-3234-4421-9c05-f2e9b897d24d req-80b4510b-485e-4b25-b95d-3bc4a6e92f36 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating instance_info_cache with network_info: [{"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:57:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b796bc6f-3234-4421-9c05-f2e9b897d24d req-80b4510b-485e-4b25-b95d-3bc4a6e92f36 service nova] Releasing lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:57:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-82d43e58-f5f2-4d6f-b156-d80172c4d861 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "2b514455-44b2-4115-bb13-38ba1713a263" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.584s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "2b514455-44b2-4115-bb13-38ba1713a263" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "2b514455-44b2-4115-bb13-38ba1713a263" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:34 user nova-compute[74646]: INFO nova.compute.manager [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Detaching volume b36d28eb-4c7b-421a-aa79-7a17e138ea2a
Oct 26 15:57:34 user nova-compute[74646]: INFO nova.virt.block_device [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Attempting to driver detach volume b36d28eb-4c7b-421a-aa79-7a17e138ea2a from mountpoint /dev/vdb
Oct 26 15:57:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Attempting to detach device vdb from instance 2b514455-44b2-4115-bb13-38ba1713a263 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 15:57:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 15:57:34 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:57:34 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 15:57:34 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:57:34 user nova-compute[74646]:   <serial>b36d28eb-4c7b-421a-aa79-7a17e138ea2a</serial>
Oct 26 15:57:34 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 15:57:34 user nova-compute[74646]: </disk>
Oct 26 15:57:34 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:57:34 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Successfully detached device vdb from instance 2b514455-44b2-4115-bb13-38ba1713a263 from the persistent domain config.
Oct 26 15:57:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2b514455-44b2-4115-bb13-38ba1713a263 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 15:57:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 15:57:34 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:57:34 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 15:57:34 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:57:34 user nova-compute[74646]:   <serial>b36d28eb-4c7b-421a-aa79-7a17e138ea2a</serial>
Oct 26 15:57:34 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 15:57:34 user nova-compute[74646]: </disk>
Oct 26 15:57:34 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:57:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2b514455-44b2-4115-bb13-38ba1713a263 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 15:57:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:38 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:57:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:38 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:57:38 user nova-compute[74646]: INFO nova.compute.claims [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Claim successful on node user
Oct 26 15:57:38 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:57:38 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:57:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:38 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:57:39 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:57:39 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:57:39 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Creating image(s)
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "/opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "/opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "/opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG nova.policy [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '207cd8b6d7994d198a7068a196cc1455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63fd26edea684a8d997c1b577ff8d859', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.207s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.192s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk 1073741824" returned: 0 in 0.047s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.180s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:40 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Cannot resize image /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:57:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:57:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Ensure instance console log exists: /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:57:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:40 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Successfully created port: a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:57:41 user nova-compute[74646]: INFO nova.compute.manager [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] [instance: 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7] Took 27.38 seconds to detach 3 volumes for instance.
Oct 26 15:57:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Successfully updated port: a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "refresh_cache-89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquired lock "refresh_cache-89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-4cdd73d7-4849-4b46-97ac-d039acc5a855 req-d780256a-9cb7-4070-86bc-65f914ec75fd service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Received event network-changed-a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-4cdd73d7-4849-4b46-97ac-d039acc5a855 req-d780256a-9cb7-4070-86bc-65f914ec75fd service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Refreshing instance network info cache due to event network-changed-a74a819f-2d80-4dca-bf03-eb6bf80868ba. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4cdd73d7-4849-4b46-97ac-d039acc5a855 req-d780256a-9cb7-4070-86bc-65f914ec75fd service nova] Acquiring lock "refresh_cache-89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.382s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:42 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Deleted allocations for instance 72c080e8-7d97-41c2-8dc3-4e70dab3b9d7
Oct 26 15:57:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bf6ae1f0-d73d-49ce-833f-07401c97d8a3 tempest-TaggedBootDevicesTest-414809244 tempest-TaggedBootDevicesTest-414809244-project-member] Lock "72c080e8-7d97-41c2-8dc3-4e70dab3b9d7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 36.928s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Updating instance_info_cache with network_info: [{"id": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "address": "fa:16:3e:cc:b0:d3", "network": {"id": "d4f65670-c099-417c-97c5-e3233f89a476", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1710572970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fd26edea684a8d997c1b577ff8d859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a819f-2d", "ovs_interfaceid": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Releasing lock "refresh_cache-89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Instance network_info: |[{"id": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "address": "fa:16:3e:cc:b0:d3", "network": {"id": "d4f65670-c099-417c-97c5-e3233f89a476", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1710572970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fd26edea684a8d997c1b577ff8d859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a819f-2d", "ovs_interfaceid": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4cdd73d7-4849-4b46-97ac-d039acc5a855 req-d780256a-9cb7-4070-86bc-65f914ec75fd service nova] Acquired lock "refresh_cache-89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.network.neutron [req-4cdd73d7-4849-4b46-97ac-d039acc5a855 req-d780256a-9cb7-4070-86bc-65f914ec75fd service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Refreshing network info cache for port a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Start _get_guest_xml network_info=[{"id": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "address": "fa:16:3e:cc:b0:d3", "network": {"id": "d4f65670-c099-417c-97c5-e3233f89a476", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1710572970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fd26edea684a8d997c1b577ff8d859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a819f-2d", "ovs_interfaceid": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:57:42 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:57:42 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:57:42 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-129527195',display_name='tempest-SnapshotDataIntegrityTests-server-129527195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-129527195',id=18,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeHOIHOktuyx2WIEcsYqkh8fe5sPyHUl9nE10Nl77UQW5w8sR3gMZ1hGHcGcH5g6TTKp6uXRXWITQ294MOmx7fURmc4lGmiS4sggonAu+FOqJY3SHctp0TkyKFEAV5cjA==',key_name='tempest-keypair-901959329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63fd26edea684a8d997c1b577ff8d859',ramdisk_id='',reservation_id='r-tune5b4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-204349635',owner_user_name='tempest-SnapshotDataIntegrityTests-204349635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='207cd8b6d7994d198a7068a196cc1455',uuid=89f3a200-afb7-4c79-a6a1-5a1b434aeaa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "address": "fa:16:3e:cc:b0:d3", "network": {"id": "d4f65670-c099-417c-97c5-e3233f89a476", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1710572970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fd26edea684a8d997c1b577ff8d859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a819f-2d", "ovs_interfaceid": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Converting VIF {"id": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "address": "fa:16:3e:cc:b0:d3", "network": {"id": "d4f65670-c099-417c-97c5-e3233f89a476", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1710572970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fd26edea684a8d997c1b577ff8d859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a819f-2d", "ovs_interfaceid": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b0:d3,bridge_name='br-int',has_traffic_filtering=True,id=a74a819f-2d80-4dca-bf03-eb6bf80868ba,network=Network(d4f65670-c099-417c-97c5-e3233f89a476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74a819f-2d') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG nova.objects.instance [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lazy-loading 'pci_devices' on Instance uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:57:43 user nova-compute[74646]:   <uuid>89f3a200-afb7-4c79-a6a1-5a1b434aeaa0</uuid>
Oct 26 15:57:43 user nova-compute[74646]:   <name>instance-00000012</name>
Oct 26 15:57:43 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:57:43 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:57:43 user nova-compute[74646]:   <metadata>
Oct 26 15:57:43 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:57:43 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:57:43 user nova-compute[74646]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-129527195</nova:name>
Oct 26 15:57:43 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:57:42</nova:creationTime>
Oct 26 15:57:43 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:57:43 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:57:43 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:57:43 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:57:43 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:57:43 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:57:43 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:57:43 user nova-compute[74646]:       <nova:owner>
Oct 26 15:57:43 user nova-compute[74646]:         <nova:user uuid="207cd8b6d7994d198a7068a196cc1455">tempest-SnapshotDataIntegrityTests-204349635-project-member</nova:user>
Oct 26 15:57:43 user nova-compute[74646]:         <nova:project uuid="63fd26edea684a8d997c1b577ff8d859">tempest-SnapshotDataIntegrityTests-204349635</nova:project>
Oct 26 15:57:43 user nova-compute[74646]:       </nova:owner>
Oct 26 15:57:43 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:57:43 user nova-compute[74646]:       <nova:ports>
Oct 26 15:57:43 user nova-compute[74646]:         <nova:port uuid="a74a819f-2d80-4dca-bf03-eb6bf80868ba">
Oct 26 15:57:43 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 15:57:43 user nova-compute[74646]:         </nova:port>
Oct 26 15:57:43 user nova-compute[74646]:       </nova:ports>
Oct 26 15:57:43 user nova-compute[74646]:     </nova:instance>
Oct 26 15:57:43 user nova-compute[74646]:   </metadata>
Oct 26 15:57:43 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:57:43 user nova-compute[74646]:     <system>
Oct 26 15:57:43 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:57:43 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:57:43 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:57:43 user nova-compute[74646]:       <entry name="serial">89f3a200-afb7-4c79-a6a1-5a1b434aeaa0</entry>
Oct 26 15:57:43 user nova-compute[74646]:       <entry name="uuid">89f3a200-afb7-4c79-a6a1-5a1b434aeaa0</entry>
Oct 26 15:57:43 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:57:43 user nova-compute[74646]:     </system>
Oct 26 15:57:43 user nova-compute[74646]:   </sysinfo>
Oct 26 15:57:43 user nova-compute[74646]:   <os>
Oct 26 15:57:43 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:57:43 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:57:43 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:57:43 user nova-compute[74646]:   </os>
Oct 26 15:57:43 user nova-compute[74646]:   <features>
Oct 26 15:57:43 user nova-compute[74646]:     <acpi/>
Oct 26 15:57:43 user nova-compute[74646]:     <apic/>
Oct 26 15:57:43 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:57:43 user nova-compute[74646]:   </features>
Oct 26 15:57:43 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:57:43 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:57:43 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:57:43 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:57:43 user nova-compute[74646]:   </clock>
Oct 26 15:57:43 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:57:43 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:57:43 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:57:43 user nova-compute[74646]:   </cpu>
Oct 26 15:57:43 user nova-compute[74646]:   <devices>
Oct 26 15:57:43 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:57:43 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:57:43 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk"/>
Oct 26 15:57:43 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:57:43 user nova-compute[74646]:     </disk>
Oct 26 15:57:43 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:57:43 user nova-compute[74646]:       <mac address="fa:16:3e:cc:b0:d3"/>
Oct 26 15:57:43 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:57:43 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:57:43 user nova-compute[74646]:       <target dev="tapa74a819f-2d"/>
Oct 26 15:57:43 user nova-compute[74646]:     </interface>
Oct 26 15:57:43 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:57:43 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/console.log" append="off"/>
Oct 26 15:57:43 user nova-compute[74646]:     </serial>
Oct 26 15:57:43 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:57:43 user nova-compute[74646]:     <video>
Oct 26 15:57:43 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:57:43 user nova-compute[74646]:     </video>
Oct 26 15:57:43 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:57:43 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:57:43 user nova-compute[74646]:     </rng>
Oct 26 15:57:43 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:57:43 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:57:43 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:57:43 user nova-compute[74646]:     </memballoon>
Oct 26 15:57:43 user nova-compute[74646]:   </devices>
Oct 26 15:57:43 user nova-compute[74646]: </domain>
Oct 26 15:57:43 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-129527195',display_name='tempest-SnapshotDataIntegrityTests-server-129527195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-129527195',id=18,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeHOIHOktuyx2WIEcsYqkh8fe5sPyHUl9nE10Nl77UQW5w8sR3gMZ1hGHcGcH5g6TTKp6uXRXWITQ294MOmx7fURmc4lGmiS4sggonAu+FOqJY3SHctp0TkyKFEAV5cjA==',key_name='tempest-keypair-901959329',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='63fd26edea684a8d997c1b577ff8d859',ramdisk_id='',reservation_id='r-tune5b4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-204349635',owner_user_name='tempest-SnapshotDataIntegrityTests-204349635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='207cd8b6d7994d198a7068a196cc1455',uuid=89f3a200-afb7-4c79-a6a1-5a1b434aeaa0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "address": "fa:16:3e:cc:b0:d3", "network": {"id": "d4f65670-c099-417c-97c5-e3233f89a476", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1710572970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fd26edea684a8d997c1b577ff8d859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a819f-2d", "ovs_interfaceid": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Converting VIF {"id": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "address": "fa:16:3e:cc:b0:d3", "network": {"id": "d4f65670-c099-417c-97c5-e3233f89a476", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1710572970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fd26edea684a8d997c1b577ff8d859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a819f-2d", "ovs_interfaceid": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b0:d3,bridge_name='br-int',has_traffic_filtering=True,id=a74a819f-2d80-4dca-bf03-eb6bf80868ba,network=Network(d4f65670-c099-417c-97c5-e3233f89a476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74a819f-2d') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG os_vif [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b0:d3,bridge_name='br-int',has_traffic_filtering=True,id=a74a819f-2d80-4dca-bf03-eb6bf80868ba,network=Network(d4f65670-c099-417c-97c5-e3233f89a476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74a819f-2d') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'aaf9527f-e42a-5e17-b229-2ff952afcfd1', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa74a819f-2d, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa74a819f-2d, col_values=(('qos', UUID('35a68a0a-7f6b-4793-8cb2-d1257d4e7ca4')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa74a819f-2d, col_values=(('external_ids', {'iface-id': 'a74a819f-2d80-4dca-bf03-eb6bf80868ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:b0:d3', 'vm-uuid': '89f3a200-afb7-4c79-a6a1-5a1b434aeaa0'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:43 user nova-compute[74646]: INFO os_vif [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:b0:d3,bridge_name='br-int',has_traffic_filtering=True,id=a74a819f-2d80-4dca-bf03-eb6bf80868ba,network=Network(d4f65670-c099-417c-97c5-e3233f89a476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74a819f-2d')
Oct 26 15:57:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] No VIF found with MAC fa:16:3e:cc:b0:d3, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG nova.network.neutron [req-4cdd73d7-4849-4b46-97ac-d039acc5a855 req-d780256a-9cb7-4070-86bc-65f914ec75fd service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Updated VIF entry in instance network info cache for port a74a819f-2d80-4dca-bf03-eb6bf80868ba. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG nova.network.neutron [req-4cdd73d7-4849-4b46-97ac-d039acc5a855 req-d780256a-9cb7-4070-86bc-65f914ec75fd service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Updating instance_info_cache with network_info: [{"id": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "address": "fa:16:3e:cc:b0:d3", "network": {"id": "d4f65670-c099-417c-97c5-e3233f89a476", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1710572970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fd26edea684a8d997c1b577ff8d859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a819f-2d", "ovs_interfaceid": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:57:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4cdd73d7-4849-4b46-97ac-d039acc5a855 req-d780256a-9cb7-4070-86bc-65f914ec75fd service nova] Releasing lock "refresh_cache-89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:57:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:44 user nova-compute[74646]: DEBUG nova.compute.manager [req-44e301fd-e3ce-4eef-b8bb-f0a2d62870da req-0188ac27-1084-496e-b415-ef68900ac144 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Received event network-vif-plugged-a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-44e301fd-e3ce-4eef-b8bb-f0a2d62870da req-0188ac27-1084-496e-b415-ef68900ac144 service nova] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-44e301fd-e3ce-4eef-b8bb-f0a2d62870da req-0188ac27-1084-496e-b415-ef68900ac144 service nova] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-44e301fd-e3ce-4eef-b8bb-f0a2d62870da req-0188ac27-1084-496e-b415-ef68900ac144 service nova] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:44 user nova-compute[74646]: DEBUG nova.compute.manager [req-44e301fd-e3ce-4eef-b8bb-f0a2d62870da req-0188ac27-1084-496e-b415-ef68900ac144 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] No waiting events found dispatching network-vif-plugged-a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:44 user nova-compute[74646]: WARNING nova.compute.manager [req-44e301fd-e3ce-4eef-b8bb-f0a2d62870da req-0188ac27-1084-496e-b415-ef68900ac144 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Received unexpected event network-vif-plugged-a74a819f-2d80-4dca-bf03-eb6bf80868ba for instance with vm_state building and task_state spawning.
Oct 26 15:57:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:46 user nova-compute[74646]: DEBUG nova.compute.manager [req-f5eb22d0-a343-44e4-92a1-a526410b2bd3 req-f5cc4733-29d7-4ee7-a337-5186e8a3ad00 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Received event network-vif-plugged-a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f5eb22d0-a343-44e4-92a1-a526410b2bd3 req-f5cc4733-29d7-4ee7-a337-5186e8a3ad00 service nova] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f5eb22d0-a343-44e4-92a1-a526410b2bd3 req-f5cc4733-29d7-4ee7-a337-5186e8a3ad00 service nova] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f5eb22d0-a343-44e4-92a1-a526410b2bd3 req-f5cc4733-29d7-4ee7-a337-5186e8a3ad00 service nova] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:46 user nova-compute[74646]: DEBUG nova.compute.manager [req-f5eb22d0-a343-44e4-92a1-a526410b2bd3 req-f5cc4733-29d7-4ee7-a337-5186e8a3ad00 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] No waiting events found dispatching network-vif-plugged-a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:46 user nova-compute[74646]: WARNING nova.compute.manager [req-f5eb22d0-a343-44e4-92a1-a526410b2bd3 req-f5cc4733-29d7-4ee7-a337-5186e8a3ad00 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Received unexpected event network-vif-plugged-a74a819f-2d80-4dca-bf03-eb6bf80868ba for instance with vm_state building and task_state spawning.
Oct 26 15:57:47 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:47 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Instance spawned successfully.
Oct 26 15:57:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:57:47 user nova-compute[74646]: INFO nova.compute.manager [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Took 7.98 seconds to spawn the instance on the hypervisor.
Oct 26 15:57:47 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:57:47 user nova-compute[74646]: INFO nova.compute.manager [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Took 8.86 seconds to build instance.
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0bb6e9ba-c620-4438-bec0-0ba9ff43491f tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.971s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZUunjhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:57:47 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:57:47 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:57:47 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[da379db5-4c13-429c-be9e-d9fd66745eea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:57:47 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d664cdf-0411-4fdb-932d-9bff7d30ef85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0] added
Oct 26 15:57:47 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c22e817-c746-4510-b0f9-f5a81a4ee15d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b438dd3-2ed2-4b79-a575-4a241d8b0cd0]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZUunjhp {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zZUunjhp" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f87d128-b2b4-4d5a-8356-25e1d82a7759]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zZUunjhp'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af55c72-f237-4deb-8784-01532ab6adb6]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf905c35-6770-41df-bf8f-658808c787d9]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)
Oct 26 15:57:47 user nova-compute[74646]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a (non-flash)
Oct 26 15:57:47 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)
Oct 26 15:57:47 user nova-compute[74646]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a (non-flash)
Oct 26 15:57:47 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6351a1c7-4b15-4b06-9822-a54e1819ea4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0, portal: 172.16.0.220,3260]
Oct 26 15:57:47 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0, portal: 172.16.0.220,3260] successful.
Oct 26 15:57:47 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af24d9e-369c-4e17-8bb6-e52fb4f34e6a]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eae9181-06c7-4307-9608-92ba03f81781]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)
Oct 26 15:57:47 user nova-compute[74646]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a (non-flash)
Oct 26 15:57:47 user nova-compute[74646]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)
Oct 26 15:57:47 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)
Oct 26 15:57:47 user nova-compute[74646]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a (non-flash)
Oct 26 15:57:47 user nova-compute[74646]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)
Oct 26 15:57:47 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.041s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c3edf1-4e49-447f-91f3-a76ec8b9cfb2]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:57:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZUunjhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:57:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.459s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:57:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '26465373231363762', 'path': '/dev/sdd'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:57:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26465373231363762', 'path': '/dev/sdd'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:57:48 user nova-compute[74646]: DEBUG nova.objects.instance [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lazy-loading 'flavor' on Instance uuid 5fbfcaaa-f050-473e-9e59-e48179a606e2 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:57:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 15:57:49 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:57:49 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 15:57:49 user nova-compute[74646]:   <target dev="vdc" bus="virtio"/>
Oct 26 15:57:49 user nova-compute[74646]:   <serial>f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0</serial>
Oct 26 15:57:49 user nova-compute[74646]: </disk>
Oct 26 15:57:49 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 15:57:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:57:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:57:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:57:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] No VIF found with MAC fa:16:3e:10:ee:9c, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:57:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6be3228a-6e85-4290-a846-7a4391120c46 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.099s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:50 user nova-compute[74646]: INFO nova.compute.manager [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Detaching volume 9003ceeb-4d8a-4e31-a41f-b5466741b45f
Oct 26 15:57:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:50 user nova-compute[74646]: INFO nova.virt.block_device [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Attempting to driver detach volume 9003ceeb-4d8a-4e31-a41f-b5466741b45f from mountpoint /dev/vdb
Oct 26 15:57:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Attempting to detach device vdb from instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 15:57:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 15:57:50 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:57:50 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 15:57:50 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:57:50 user nova-compute[74646]:   <serial>9003ceeb-4d8a-4e31-a41f-b5466741b45f</serial>
Oct 26 15:57:50 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 15:57:50 user nova-compute[74646]: </disk>
Oct 26 15:57:50 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:57:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Successfully detached device vdb from instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 from the persistent domain config.
Oct 26 15:57:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 15:57:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 15:57:50 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:57:50 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 15:57:50 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:57:50 user nova-compute[74646]:   <serial>9003ceeb-4d8a-4e31-a41f-b5466741b45f</serial>
Oct 26 15:57:50 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 15:57:50 user nova-compute[74646]: </disk>
Oct 26 15:57:50 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:57:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 15:57:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-dca2b39e-0324-4c4d-9c21-e3d0d632091f req-7975b9cb-933b-453e-b1bf-59788e7fec01 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received event network-changed-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-dca2b39e-0324-4c4d-9c21-e3d0d632091f req-7975b9cb-933b-453e-b1bf-59788e7fec01 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Refreshing instance network info cache due to event network-changed-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:57:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dca2b39e-0324-4c4d-9c21-e3d0d632091f req-7975b9cb-933b-453e-b1bf-59788e7fec01 service nova] Acquiring lock "refresh_cache-65393333-197f-400e-89b5-7438f5697169" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:57:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dca2b39e-0324-4c4d-9c21-e3d0d632091f req-7975b9cb-933b-453e-b1bf-59788e7fec01 service nova] Acquired lock "refresh_cache-65393333-197f-400e-89b5-7438f5697169" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:57:52 user nova-compute[74646]: DEBUG nova.network.neutron [req-dca2b39e-0324-4c4d-9c21-e3d0d632091f req-7975b9cb-933b-453e-b1bf-59788e7fec01 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Refreshing network info cache for port bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:57:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "65393333-197f-400e-89b5-7438f5697169" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "65393333-197f-400e-89b5-7438f5697169" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:52 user nova-compute[74646]: DEBUG nova.objects.instance [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lazy-loading 'flavor' on Instance uuid 65393333-197f-400e-89b5-7438f5697169 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:57:52 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Ignoring supplied device name: /dev/vdb
Oct 26 15:57:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "65393333-197f-400e-89b5-7438f5697169" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.111s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:52 user nova-compute[74646]: DEBUG nova.network.neutron [req-dca2b39e-0324-4c4d-9c21-e3d0d632091f req-7975b9cb-933b-453e-b1bf-59788e7fec01 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Updated VIF entry in instance network info cache for port bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:57:52 user nova-compute[74646]: DEBUG nova.network.neutron [req-dca2b39e-0324-4c4d-9c21-e3d0d632091f req-7975b9cb-933b-453e-b1bf-59788e7fec01 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Updating instance_info_cache with network_info: [{"id": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "address": "fa:16:3e:1c:80:7c", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba2fc0f-9e", "ovs_interfaceid": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "65393333-197f-400e-89b5-7438f5697169" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "65393333-197f-400e-89b5-7438f5697169" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:53 user nova-compute[74646]: INFO nova.compute.manager [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Attaching volume b7b752eb-7344-408e-8ae3-8980db762634 to /dev/vdb
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dca2b39e-0324-4c4d-9c21-e3d0d632091f req-7975b9cb-933b-453e-b1bf-59788e7fec01 service nova] Releasing lock "refresh_cache-65393333-197f-400e-89b5-7438f5697169" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG os_brick.utils [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba024294-cce8-4bf2-95df-36eb7ec9fe01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[322087b9-b888-4217-9e4f-ef1cb6b5ccc7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54fb197-e0d7-46af-a483-e4b569bf6f6e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c91481-74f2-47f4-8e86-3edc699b5a4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:57:53 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:57:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8083a57c-231a-4ae2-b4d8-d7a1dfe0c784]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG os_brick.utils [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:57:53 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Updating existing volume attachment record: 7fedbdfd-4a07-4f36-a9b0-7945dae8b69e {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "1c5d5313-72f0-4f49-83b7-f277d5da4191" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:54 user nova-compute[74646]: INFO nova.compute.manager [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Terminating instance
Oct 26 15:57:54 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG nova.compute.manager [req-1c31206c-6659-472c-ba61-b17cd7cb0b7c req-cd6ab87b-8cbd-4e7e-9161-7f4a2fc17f57 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Received event network-vif-unplugged-529d94bf-3278-41ad-b2c1-522b68db2421 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1c31206c-6659-472c-ba61-b17cd7cb0b7c req-cd6ab87b-8cbd-4e7e-9161-7f4a2fc17f57 service nova] Acquiring lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1c31206c-6659-472c-ba61-b17cd7cb0b7c req-cd6ab87b-8cbd-4e7e-9161-7f4a2fc17f57 service nova] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1c31206c-6659-472c-ba61-b17cd7cb0b7c req-cd6ab87b-8cbd-4e7e-9161-7f4a2fc17f57 service nova] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG nova.compute.manager [req-1c31206c-6659-472c-ba61-b17cd7cb0b7c req-cd6ab87b-8cbd-4e7e-9161-7f4a2fc17f57 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] No waiting events found dispatching network-vif-unplugged-529d94bf-3278-41ad-b2c1-522b68db2421 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG nova.compute.manager [req-1c31206c-6659-472c-ba61-b17cd7cb0b7c req-cd6ab87b-8cbd-4e7e-9161-7f4a2fc17f57 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Received event network-vif-unplugged-529d94bf-3278-41ad-b2c1-522b68db2421 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:57:54 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2b514455-44b2-4115-bb13-38ba1713a263 is timed out.
Oct 26 15:57:54 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Successfully detached device vdb from instance 2b514455-44b2-4115-bb13-38ba1713a263 from the live domain config.
Oct 26 15:57:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cDvlTEXN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:57:54 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:57:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1237bf9-1252-45c7-a687-ffc9367fa1cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:57:54 user nova-compute[74646]: No targets found.
Oct 26 15:57:54 user nova-compute[74646]: iSNS:
Oct 26 15:57:54 user nova-compute[74646]: No targets found.
Oct 26 15:57:54 user nova-compute[74646]: STATIC:
Oct 26 15:57:54 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a
Oct 26 15:57:54 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:57:54 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:57:54 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0
Oct 26 15:57:54 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:57:54 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:57:54 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f
Oct 26 15:57:54 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:57:54 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:57:54 user nova-compute[74646]: FIRMWARE:
Oct 26 15:57:54 user nova-compute[74646]: No targets found.
Oct 26 15:57:54 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:57:54 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:57:54 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:57:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.053s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe4b6fc-6daf-480e-802e-ff5ca7a68f98]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:57:55 user nova-compute[74646]: INFO nova.compute.claims [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Claim successful on node user
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b478b771-8b43-4f4e-b0cd-62c5323684a1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)
Oct 26 15:57:55 user nova-compute[74646]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a (non-flash)
Oct 26 15:57:55 user nova-compute[74646]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)
Oct 26 15:57:55 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)
Oct 26 15:57:55 user nova-compute[74646]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a (non-flash)
Oct 26 15:57:55 user nova-compute[74646]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)
Oct 26 15:57:55 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d031d120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a'): ({'sdc'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Removing single pathed devices sdc {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4482a9ab-690d-4de8-91a3-c1d681da3d87]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2c7a91-8c23-419d-a58e-5d36c9b29373]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Flushing IO for device /dev/sdc {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f53e1e-f2dc-4707-85ac-21f89d71a396]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[15aaf513-f09f-4a79-9828-3c4c46200ae3]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:55 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Instance destroyed successfully.
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.objects.instance [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lazy-loading 'resources' on Instance uuid 1c5d5313-72f0-4f49-83b7-f277d5da4191 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.036s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8089ccb-56e8-4fd9-a974-1216b39e1314]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:48:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1376727781',display_name='tempest-ServersNegativeTestJSON-server-1376727781',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1376727781',id=1,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:48:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e9743ac2f5304819835c4f369c376e31',ramdisk_id='',reservation_id='r-tkjx807k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-986135927',owner_user_name='tempest-ServersNegativeTestJSON-986135927-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:48:36Z,user_data=None,user_id='9c53fa7260a54cee97a07bc12f78144e',uuid=1c5d5313-72f0-4f49-83b7-f277d5da4191,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "529d94bf-3278-41ad-b2c1-522b68db2421", "address": "fa:16:3e:2e:e2:50", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529d94bf-32", "ovs_interfaceid": "529d94bf-3278-41ad-b2c1-522b68db2421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Converting VIF {"id": "529d94bf-3278-41ad-b2c1-522b68db2421", "address": "fa:16:3e:2e:e2:50", "network": {"id": "553f3b75-4be8-40fa-a771-51ae8487bd58", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-2047924985-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e9743ac2f5304819835c4f369c376e31", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap529d94bf-32", "ovs_interfaceid": "529d94bf-3278-41ad-b2c1-522b68db2421", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:e2:50,bridge_name='br-int',has_traffic_filtering=True,id=529d94bf-3278-41ad-b2c1-522b68db2421,network=Network(553f3b75-4be8-40fa-a771-51ae8487bd58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529d94bf-32') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_vif [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:e2:50,bridge_name='br-int',has_traffic_filtering=True,id=529d94bf-3278-41ad-b2c1-522b68db2421,network=Network(553f3b75-4be8-40fa-a771-51ae8487bd58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529d94bf-32') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap529d94bf-32, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7945997a-2f33-486b-9a3d-a533fa38b0d4) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:55 user nova-compute[74646]: INFO os_vif [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:e2:50,bridge_name='br-int',has_traffic_filtering=True,id=529d94bf-3278-41ad-b2c1-522b68db2421,network=Network(553f3b75-4be8-40fa-a771-51ae8487bd58),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap529d94bf-32')
Oct 26 15:57:55 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Deleting instance files /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191_del
Oct 26 15:57:55 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Deletion of /opt/stack/data/nova/instances/1c5d5313-72f0-4f49-83b7-f277d5da4191_del complete
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25a7e31-2182-4f98-826c-7178c7a01ea4]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a, portal: 172.16.0.220,3260]
Oct 26 15:57:55 user nova-compute[74646]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a, portal: 172.16.0.220,3260] successful.
Oct 26 15:57:55 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b36d28eb-4c7b-421a-aa79-7a17e138ea2a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[08fcb9eb-e21a-4802-a14f-f1edea09c81c]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.443s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] <== disconnect_volume: return (445ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:57:55 user nova-compute[74646]: INFO nova.compute.manager [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Took 1.18 seconds to destroy the instance on the hypervisor.
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.601s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:57:55 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.policy [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e00e398f6dc344f4afaa44c119f87f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e982f0135534a22ba32bb089b85d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:57:55 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Creating image(s)
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "/opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "/opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "/opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "27db2f851d6207ab52ca80339dcd08bf0214f75f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "27db2f851d6207ab52ca80339dcd08bf0214f75f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f.part --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-eba40e2c-a10f-4ca3-ba34-6e6c0ceec9a4 req-cfec440f-6802-4237-89de-12d927df3d56 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Received event network-vif-plugged-529d94bf-3278-41ad-b2c1-522b68db2421 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-eba40e2c-a10f-4ca3-ba34-6e6c0ceec9a4 req-cfec440f-6802-4237-89de-12d927df3d56 service nova] Acquiring lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-eba40e2c-a10f-4ca3-ba34-6e6c0ceec9a4 req-cfec440f-6802-4237-89de-12d927df3d56 service nova] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-eba40e2c-a10f-4ca3-ba34-6e6c0ceec9a4 req-cfec440f-6802-4237-89de-12d927df3d56 service nova] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-eba40e2c-a10f-4ca3-ba34-6e6c0ceec9a4 req-cfec440f-6802-4237-89de-12d927df3d56 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] No waiting events found dispatching network-vif-plugged-529d94bf-3278-41ad-b2c1-522b68db2421 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:57:56 user nova-compute[74646]: WARNING nova.compute.manager [req-eba40e2c-a10f-4ca3-ba34-6e6c0ceec9a4 req-cfec440f-6802-4237-89de-12d927df3d56 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Received unexpected event network-vif-plugged-529d94bf-3278-41ad-b2c1-522b68db2421 for instance with vm_state active and task_state deleting.
Oct 26 15:57:56 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Successfully created port: e7148f30-9808-4eaa-a3e1-007a3b5755d6 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:57:56 user nova-compute[74646]: DEBUG nova.objects.instance [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lazy-loading 'flavor' on Instance uuid 2b514455-44b2-4115-bb13-38ba1713a263 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:57:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f.part --force-share --output=json" returned: 0 in 0.296s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:56 user nova-compute[74646]: DEBUG nova.virt.images [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] 4ec27269-d015-4036-b13b-215b23be7635 was qcow2, converting to raw {{(pid=74646) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 15:57:56 user nova-compute[74646]: DEBUG nova.privsep.utils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74646) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 15:57:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f.part /opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f.converted {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d6e1b9ee-6edf-4dac-adc0-24cdcb532697 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "2b514455-44b2-4115-bb13-38ba1713a263" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.636s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f.part /opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f.converted" returned: 0 in 0.256s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f.converted --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-ec768213-7085-433c-958e-2df0988f9a19 req-135cccdc-6ef5-4ec3-bced-8f9bd5226806 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Received event network-vif-deleted-529d94bf-3278-41ad-b2c1-522b68db2421 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:57 user nova-compute[74646]: INFO nova.compute.manager [req-ec768213-7085-433c-958e-2df0988f9a19 req-135cccdc-6ef5-4ec3-bced-8f9bd5226806 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Neutron deleted interface 529d94bf-3278-41ad-b2c1-522b68db2421; detaching it from the instance and deleting it from the info cache
Oct 26 15:57:57 user nova-compute[74646]: DEBUG nova.network.neutron [req-ec768213-7085-433c-958e-2df0988f9a19 req-135cccdc-6ef5-4ec3-bced-8f9bd5226806 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:57:57 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Took 1.70 seconds to deallocate network for instance.
Oct 26 15:57:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-ec768213-7085-433c-958e-2df0988f9a19 req-135cccdc-6ef5-4ec3-bced-8f9bd5226806 service nova] [instance: 1c5d5313-72f0-4f49-83b7-f277d5da4191] Detach interface failed, port_id=529d94bf-3278-41ad-b2c1-522b68db2421, reason: Instance 1c5d5313-72f0-4f49-83b7-f277d5da4191 could not be found. {{(pid=74646) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f.converted --force-share --output=json" returned: 0 in 0.321s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "27db2f851d6207ab52ca80339dcd08bf0214f75f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.401s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f --force-share --output=json" returned: 0 in 0.266s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "27db2f851d6207ab52ca80339dcd08bf0214f75f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "27db2f851d6207ab52ca80339dcd08bf0214f75f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Successfully updated port: e7148f30-9808-4eaa-a3e1-007a3b5755d6 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "refresh_cache-51088a91-dc4a-467c-8f35-3c85a9ddd3c4" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquired lock "refresh_cache-51088a91-dc4a-467c-8f35-3c85a9ddd3c4" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.533s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:57:57 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Deleted allocations for instance 1c5d5313-72f0-4f49-83b7-f277d5da4191
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f --force-share --output=json" returned: 0 in 0.244s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f,backing_fmt=raw /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f,backing_fmt=raw /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk 1073741824" returned: 0 in 0.077s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "27db2f851d6207ab52ca80339dcd08bf0214f75f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.327s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c67c4972-5cd1-4187-9c91-8bd7bca7691c tempest-ServersNegativeTestJSON-986135927 tempest-ServersNegativeTestJSON-986135927-project-member] Lock "1c5d5313-72f0-4f49-83b7-f277d5da4191" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.872s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27db2f851d6207ab52ca80339dcd08bf0214f75f --force-share --output=json" returned: 0 in 0.193s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Updating instance_info_cache with network_info: [{"id": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "address": "fa:16:3e:6e:de:12", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7148f30-98", "ovs_interfaceid": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Releasing lock "refresh_cache-51088a91-dc4a-467c-8f35-3c85a9ddd3c4" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Instance network_info: |[{"id": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "address": "fa:16:3e:6e:de:12", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7148f30-98", "ovs_interfaceid": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Cannot resize image /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Ensure instance console log exists: /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Start _get_guest_xml network_info=[{"id": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "address": "fa:16:3e:6e:de:12", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7148f30-98", "ovs_interfaceid": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:57:51Z,direct_url=<?>,disk_format='qcow2',id=4ec27269-d015-4036-b13b-215b23be7635,min_disk=0,min_ram=0,name='tempest-scenario-img--1695881656',owner='0e982f0135534a22ba32bb089b85d3f3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:57:53Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '4ec27269-d015-4036-b13b-215b23be7635'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:57:58 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:57:58 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:57:51Z,direct_url=<?>,disk_format='qcow2',id=4ec27269-d015-4036-b13b-215b23be7635,min_disk=0,min_ram=0,name='tempest-scenario-img--1695881656',owner='0e982f0135534a22ba32bb089b85d3f3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:57:53Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-685771773',display_name='tempest-TestMinimumBasicScenario-server-685771773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-685771773',id=19,image_ref='4ec27269-d015-4036-b13b-215b23be7635',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK87Tk62ZhsU/CG61uxDFSMzEXBGqUyFfRKvclBbtaJL4ojv/IQ2BQXPr33URLQyWXeqOD7CXILgdKs6RXTePkEyEi6UxF9Y2EwVLGzAzxASqMQs2iQaEXXC/nH/4qukHg==',key_name='tempest-TestMinimumBasicScenario-1356218599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e982f0135534a22ba32bb089b85d3f3',ramdisk_id='',reservation_id='r-0n2p8zgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ec27269-d015-4036-b13b-215b23be7635',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1275819184',owner_user_name='tempest-TestMinimumBasicScenario-1275819184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:57:56Z,user_data=None,user_id='e00e398f6dc344f4afaa44c119f87f2b',uuid=51088a91-dc4a-467c-8f35-3c85a9ddd3c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "address": "fa:16:3e:6e:de:12", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7148f30-98", "ovs_interfaceid": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Converting VIF {"id": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "address": "fa:16:3e:6e:de:12", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7148f30-98", "ovs_interfaceid": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:de:12,bridge_name='br-int',has_traffic_filtering=True,id=e7148f30-9808-4eaa-a3e1-007a3b5755d6,network=Network(771871f2-36c1-4cc5-aa99-b2687f67b96c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7148f30-98') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.objects.instance [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lazy-loading 'pci_devices' on Instance uuid 51088a91-dc4a-467c-8f35-3c85a9ddd3c4 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:57:58 user nova-compute[74646]:   <uuid>51088a91-dc4a-467c-8f35-3c85a9ddd3c4</uuid>
Oct 26 15:57:58 user nova-compute[74646]:   <name>instance-00000013</name>
Oct 26 15:57:58 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:57:58 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:57:58 user nova-compute[74646]:   <metadata>
Oct 26 15:57:58 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:57:58 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:57:58 user nova-compute[74646]:       <nova:name>tempest-TestMinimumBasicScenario-server-685771773</nova:name>
Oct 26 15:57:58 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:57:58</nova:creationTime>
Oct 26 15:57:58 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:57:58 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:57:58 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:57:58 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:57:58 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:57:58 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:57:58 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:57:58 user nova-compute[74646]:       <nova:owner>
Oct 26 15:57:58 user nova-compute[74646]:         <nova:user uuid="e00e398f6dc344f4afaa44c119f87f2b">tempest-TestMinimumBasicScenario-1275819184-project-member</nova:user>
Oct 26 15:57:58 user nova-compute[74646]:         <nova:project uuid="0e982f0135534a22ba32bb089b85d3f3">tempest-TestMinimumBasicScenario-1275819184</nova:project>
Oct 26 15:57:58 user nova-compute[74646]:       </nova:owner>
Oct 26 15:57:58 user nova-compute[74646]:       <nova:root type="image" uuid="4ec27269-d015-4036-b13b-215b23be7635"/>
Oct 26 15:57:58 user nova-compute[74646]:       <nova:ports>
Oct 26 15:57:58 user nova-compute[74646]:         <nova:port uuid="e7148f30-9808-4eaa-a3e1-007a3b5755d6">
Oct 26 15:57:58 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 15:57:58 user nova-compute[74646]:         </nova:port>
Oct 26 15:57:58 user nova-compute[74646]:       </nova:ports>
Oct 26 15:57:58 user nova-compute[74646]:     </nova:instance>
Oct 26 15:57:58 user nova-compute[74646]:   </metadata>
Oct 26 15:57:58 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:57:58 user nova-compute[74646]:     <system>
Oct 26 15:57:58 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:57:58 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:57:58 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:57:58 user nova-compute[74646]:       <entry name="serial">51088a91-dc4a-467c-8f35-3c85a9ddd3c4</entry>
Oct 26 15:57:58 user nova-compute[74646]:       <entry name="uuid">51088a91-dc4a-467c-8f35-3c85a9ddd3c4</entry>
Oct 26 15:57:58 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:57:58 user nova-compute[74646]:     </system>
Oct 26 15:57:58 user nova-compute[74646]:   </sysinfo>
Oct 26 15:57:58 user nova-compute[74646]:   <os>
Oct 26 15:57:58 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:57:58 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:57:58 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:57:58 user nova-compute[74646]:   </os>
Oct 26 15:57:58 user nova-compute[74646]:   <features>
Oct 26 15:57:58 user nova-compute[74646]:     <acpi/>
Oct 26 15:57:58 user nova-compute[74646]:     <apic/>
Oct 26 15:57:58 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:57:58 user nova-compute[74646]:   </features>
Oct 26 15:57:58 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:57:58 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:57:58 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:57:58 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:57:58 user nova-compute[74646]:   </clock>
Oct 26 15:57:58 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:57:58 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:57:58 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:57:58 user nova-compute[74646]:   </cpu>
Oct 26 15:57:58 user nova-compute[74646]:   <devices>
Oct 26 15:57:58 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:57:58 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:57:58 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk"/>
Oct 26 15:57:58 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:57:58 user nova-compute[74646]:     </disk>
Oct 26 15:57:58 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:57:58 user nova-compute[74646]:       <mac address="fa:16:3e:6e:de:12"/>
Oct 26 15:57:58 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:57:58 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:57:58 user nova-compute[74646]:       <target dev="tape7148f30-98"/>
Oct 26 15:57:58 user nova-compute[74646]:     </interface>
Oct 26 15:57:58 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:57:58 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/console.log" append="off"/>
Oct 26 15:57:58 user nova-compute[74646]:     </serial>
Oct 26 15:57:58 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:57:58 user nova-compute[74646]:     <video>
Oct 26 15:57:58 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:57:58 user nova-compute[74646]:     </video>
Oct 26 15:57:58 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:57:58 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:57:58 user nova-compute[74646]:     </rng>
Oct 26 15:57:58 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:57:58 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:57:58 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:57:58 user nova-compute[74646]:     </memballoon>
Oct 26 15:57:58 user nova-compute[74646]:   </devices>
Oct 26 15:57:58 user nova-compute[74646]: </domain>
Oct 26 15:57:58 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-685771773',display_name='tempest-TestMinimumBasicScenario-server-685771773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-685771773',id=19,image_ref='4ec27269-d015-4036-b13b-215b23be7635',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK87Tk62ZhsU/CG61uxDFSMzEXBGqUyFfRKvclBbtaJL4ojv/IQ2BQXPr33URLQyWXeqOD7CXILgdKs6RXTePkEyEi6UxF9Y2EwVLGzAzxASqMQs2iQaEXXC/nH/4qukHg==',key_name='tempest-TestMinimumBasicScenario-1356218599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e982f0135534a22ba32bb089b85d3f3',ramdisk_id='',reservation_id='r-0n2p8zgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ec27269-d015-4036-b13b-215b23be7635',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1275819184',owner_user_name='tempest-TestMinimumBasicScenario-1275819184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:57:56Z,user_data=None,user_id='e00e398f6dc344f4afaa44c119f87f2b',uuid=51088a91-dc4a-467c-8f35-3c85a9ddd3c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "address": "fa:16:3e:6e:de:12", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7148f30-98", "ovs_interfaceid": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Converting VIF {"id": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "address": "fa:16:3e:6e:de:12", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7148f30-98", "ovs_interfaceid": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:de:12,bridge_name='br-int',has_traffic_filtering=True,id=e7148f30-9808-4eaa-a3e1-007a3b5755d6,network=Network(771871f2-36c1-4cc5-aa99-b2687f67b96c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7148f30-98') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG os_vif [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:de:12,bridge_name='br-int',has_traffic_filtering=True,id=e7148f30-9808-4eaa-a3e1-007a3b5755d6,network=Network(771871f2-36c1-4cc5-aa99-b2687f67b96c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7148f30-98') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ef8ba3cc-e4d4-529b-acfd-1004919770d0', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape7148f30-98, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape7148f30-98, col_values=(('qos', UUID('603fd654-9e37-4ee4-b2f0-fd8b09bcd655')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape7148f30-98, col_values=(('external_ids', {'iface-id': 'e7148f30-9808-4eaa-a3e1-007a3b5755d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:de:12', 'vm-uuid': '51088a91-dc4a-467c-8f35-3c85a9ddd3c4'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:57:58 user nova-compute[74646]: INFO os_vif [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:de:12,bridge_name='br-int',has_traffic_filtering=True,id=e7148f30-9808-4eaa-a3e1-007a3b5755d6,network=Network(771871f2-36c1-4cc5-aa99-b2687f67b96c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7148f30-98')
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] No VIF found with MAC fa:16:3e:6e:de:12, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-1d86d752-3c70-45b3-970f-f8dc6d8ed7ae req-11f484cf-d354-4b22-8565-fed2aececca6 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Received event network-changed-e7148f30-9808-4eaa-a3e1-007a3b5755d6 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-1d86d752-3c70-45b3-970f-f8dc6d8ed7ae req-11f484cf-d354-4b22-8565-fed2aececca6 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Refreshing instance network info cache due to event network-changed-e7148f30-9808-4eaa-a3e1-007a3b5755d6. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1d86d752-3c70-45b3-970f-f8dc6d8ed7ae req-11f484cf-d354-4b22-8565-fed2aececca6 service nova] Acquiring lock "refresh_cache-51088a91-dc4a-467c-8f35-3c85a9ddd3c4" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1d86d752-3c70-45b3-970f-f8dc6d8ed7ae req-11f484cf-d354-4b22-8565-fed2aececca6 service nova] Acquired lock "refresh_cache-51088a91-dc4a-467c-8f35-3c85a9ddd3c4" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:57:58 user nova-compute[74646]: DEBUG nova.network.neutron [req-1d86d752-3c70-45b3-970f-f8dc6d8ed7ae req-11f484cf-d354-4b22-8565-fed2aececca6 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Refreshing network info cache for port e7148f30-9808-4eaa-a3e1-007a3b5755d6 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:57:59 user nova-compute[74646]: DEBUG nova.network.neutron [req-1d86d752-3c70-45b3-970f-f8dc6d8ed7ae req-11f484cf-d354-4b22-8565-fed2aececca6 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Updated VIF entry in instance network info cache for port e7148f30-9808-4eaa-a3e1-007a3b5755d6. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:57:59 user nova-compute[74646]: DEBUG nova.network.neutron [req-1d86d752-3c70-45b3-970f-f8dc6d8ed7ae req-11f484cf-d354-4b22-8565-fed2aececca6 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Updating instance_info_cache with network_info: [{"id": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "address": "fa:16:3e:6e:de:12", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7148f30-98", "ovs_interfaceid": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:57:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1d86d752-3c70-45b3-970f-f8dc6d8ed7ae req-11f484cf-d354-4b22-8565-fed2aececca6 service nova] Releasing lock "refresh_cache-51088a91-dc4a-467c-8f35-3c85a9ddd3c4" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:57:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-5bd48c44-0c1a-41ce-9232-05a51eefeee2 req-80b1d34d-8063-40e0-afcd-568511203f40 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Received event network-vif-plugged-e7148f30-9808-4eaa-a3e1-007a3b5755d6 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:58:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5bd48c44-0c1a-41ce-9232-05a51eefeee2 req-80b1d34d-8063-40e0-afcd-568511203f40 service nova] Acquiring lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5bd48c44-0c1a-41ce-9232-05a51eefeee2 req-80b1d34d-8063-40e0-afcd-568511203f40 service nova] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5bd48c44-0c1a-41ce-9232-05a51eefeee2 req-80b1d34d-8063-40e0-afcd-568511203f40 service nova] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-5bd48c44-0c1a-41ce-9232-05a51eefeee2 req-80b1d34d-8063-40e0-afcd-568511203f40 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] No waiting events found dispatching network-vif-plugged-e7148f30-9808-4eaa-a3e1-007a3b5755d6 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:58:00 user nova-compute[74646]: WARNING nova.compute.manager [req-5bd48c44-0c1a-41ce-9232-05a51eefeee2 req-80b1d34d-8063-40e0-afcd-568511203f40 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Received unexpected event network-vif-plugged-e7148f30-9808-4eaa-a3e1-007a3b5755d6 for instance with vm_state building and task_state spawning.
Oct 26 15:58:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-0759707d-7757-4e7d-b013-2cddeb3c39c3 req-d2ea05e2-aabe-4d00-85a1-44dc6a953cbd service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Received event network-vif-plugged-e7148f30-9808-4eaa-a3e1-007a3b5755d6 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:58:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0759707d-7757-4e7d-b013-2cddeb3c39c3 req-d2ea05e2-aabe-4d00-85a1-44dc6a953cbd service nova] Acquiring lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0759707d-7757-4e7d-b013-2cddeb3c39c3 req-d2ea05e2-aabe-4d00-85a1-44dc6a953cbd service nova] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0759707d-7757-4e7d-b013-2cddeb3c39c3 req-d2ea05e2-aabe-4d00-85a1-44dc6a953cbd service nova] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-0759707d-7757-4e7d-b013-2cddeb3c39c3 req-d2ea05e2-aabe-4d00-85a1-44dc6a953cbd service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] No waiting events found dispatching network-vif-plugged-e7148f30-9808-4eaa-a3e1-007a3b5755d6 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:58:02 user nova-compute[74646]: WARNING nova.compute.manager [req-0759707d-7757-4e7d-b013-2cddeb3c39c3 req-d2ea05e2-aabe-4d00-85a1-44dc6a953cbd service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Received unexpected event network-vif-plugged-e7148f30-9808-4eaa-a3e1-007a3b5755d6 for instance with vm_state building and task_state spawning.
Oct 26 15:58:02 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:58:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:58:02 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Instance spawned successfully.
Oct 26 15:58:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:58:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:02 user nova-compute[74646]: INFO nova.compute.manager [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Took 6.78 seconds to spawn the instance on the hypervisor.
Oct 26 15:58:02 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:58:02 user nova-compute[74646]: INFO nova.compute.manager [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Took 7.92 seconds to build instance.
Oct 26 15:58:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a79c2b0-fbbf-4856-bf05-e72ca10ba440 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.065s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:58:09 user nova-compute[74646]: INFO nova.compute.claims [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Claim successful on node user
Oct 26 15:58:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "1283575f-b614-42d5-b632-c1409f295207" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "1283575f-b614-42d5-b632-c1409f295207" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.298s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:58:09 user nova-compute[74646]: INFO nova.compute.claims [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Claim successful on node user
Oct 26 15:58:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:58:09 user nova-compute[74646]: DEBUG nova.network.neutron [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:58:09 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:58:10 user nova-compute[74646]: DEBUG nova.policy [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9311cee7c04e45ddbae6f16ba43eed2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8788e95cc244f98b0ff8d593d1e067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:58:10 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Creating image(s)
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "/opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "/opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "/opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.848s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.229s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG nova.network.neutron [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:58:10 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:58:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG nova.policy [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abd7a869c235467ca4da99867c6bc0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e848952345455183c15fee816b6f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.235s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:58:10 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Creating image(s)
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "/opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "/opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "/opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.016s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk 1073741824" returned: 0 in 0.225s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.471s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Successfully created port: c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:58:11 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 is timed out.
Oct 26 15:58:11 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Successfully detached device vdb from instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 from the live domain config.
Oct 26 15:58:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XIEJGKoF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:58:11 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cbfa49-8ac7-425f-9ef4-4329a3104da7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:58:11 user nova-compute[74646]: No targets found.
Oct 26 15:58:11 user nova-compute[74646]: iSNS:
Oct 26 15:58:11 user nova-compute[74646]: No targets found.
Oct 26 15:58:11 user nova-compute[74646]: STATIC:
Oct 26 15:58:11 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0
Oct 26 15:58:11 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:58:11 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:58:11 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f
Oct 26 15:58:11 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:58:11 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:58:11 user nova-compute[74646]: FIRMWARE:
Oct 26 15:58:11 user nova-compute[74646]: No targets found.
Oct 26 15:58:11 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:58:11 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:58:11 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.277s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4880b973-bda9-4f88-b7fa-527b8a693b99]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.269s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[38708505-d058-4180-8350-1e0b331204b1]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)
Oct 26 15:58:11 user nova-compute[74646]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)
Oct 26 15:58:11 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f (non-flash)
Oct 26 15:58:11 user nova-compute[74646]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)
Oct 26 15:58:11 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d073bb50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f'): ({'sdb'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Removing single pathed devices sdb {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49983f1-d910-45a6-84a3-997852ce443c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c090c677-6bfc-4715-a540-28a56bc13207]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Flushing IO for device /dev/sdb {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec4dc8b-41a2-41ce-a291-4a861877a1c1]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.235s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec2c8aa-d61c-431d-8e0a-11cdc6016a09]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Cannot resize image /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Ensure instance console log exists: /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk 1073741824" returned: 0 in 0.076s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.322s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e29ac5d-7962-41fc-bc38-bb8b792f3580]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[560aae95-e14f-4e25-a0ea-c579a21f689f]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f, portal: 172.16.0.220,3260]
Oct 26 15:58:11 user nova-compute[74646]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f, portal: 172.16.0.220,3260] successful.
Oct 26 15:58:11 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9003ceeb-4d8a-4e31-a41f-b5466741b45f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c468bcdf-4168-4d32-97d6-05568734f882]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.525s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] <== disconnect_volume: return (528ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.204s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Successfully created port: 366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Successfully updated port: c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "refresh_cache-b79f5ea4-ea88-41b4-8ca2-116b5b6408de" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquired lock "refresh_cache-b79f5ea4-ea88-41b4-8ca2-116b5b6408de" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:58:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-07e479ec-634e-4185-a0ca-6ddeb08fc915 req-71a439cd-7005-47a1-8092-0d0b9145f9c9 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received event network-changed-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-07e479ec-634e-4185-a0ca-6ddeb08fc915 req-71a439cd-7005-47a1-8092-0d0b9145f9c9 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Refreshing instance network info cache due to event network-changed-c3fa2d89-235f-4939-8eff-e59c02c578fe. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-07e479ec-634e-4185-a0ca-6ddeb08fc915 req-71a439cd-7005-47a1-8092-0d0b9145f9c9 service nova] Acquiring lock "refresh_cache-b79f5ea4-ea88-41b4-8ca2-116b5b6408de" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Cannot resize image /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Ensure instance console log exists: /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Updating instance_info_cache with network_info: [{"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Releasing lock "refresh_cache-b79f5ea4-ea88-41b4-8ca2-116b5b6408de" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Instance network_info: |[{"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-07e479ec-634e-4185-a0ca-6ddeb08fc915 req-71a439cd-7005-47a1-8092-0d0b9145f9c9 service nova] Acquired lock "refresh_cache-b79f5ea4-ea88-41b4-8ca2-116b5b6408de" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-07e479ec-634e-4185-a0ca-6ddeb08fc915 req-71a439cd-7005-47a1-8092-0d0b9145f9c9 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Refreshing network info cache for port c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Start _get_guest_xml network_info=[{"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:58:12 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:58:12 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-587138455',display_name='tempest-tempest.common.compute-instance-587138455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-587138455',id=20,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbmmCHSiAv6wnl4y6udIFIXZEW/bOp74proj1U5AEM0+QPtfownIPyTApMq9brABhT3IwnIfBs9QKjt04IQsymoSPOFRANJzeHzmMShY1+CCmigklKl+J5T9ZIigvKl+w==',key_name='tempest-keypair-1281352566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-y115hib0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:58:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=b79f5ea4-ea88-41b4-8ca2-116b5b6408de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=c3fa2d89-235f-4939-8eff-e59c02c578fe,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fa2d89-23') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.objects.instance [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lazy-loading 'pci_devices' on Instance uuid b79f5ea4-ea88-41b4-8ca2-116b5b6408de {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:58:12 user nova-compute[74646]:   <uuid>b79f5ea4-ea88-41b4-8ca2-116b5b6408de</uuid>
Oct 26 15:58:12 user nova-compute[74646]:   <name>instance-00000014</name>
Oct 26 15:58:12 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:58:12 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:58:12 user nova-compute[74646]:   <metadata>
Oct 26 15:58:12 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:58:12 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:58:12 user nova-compute[74646]:       <nova:name>tempest-tempest.common.compute-instance-587138455</nova:name>
Oct 26 15:58:12 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:58:12</nova:creationTime>
Oct 26 15:58:12 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:58:12 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:58:12 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:58:12 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:58:12 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:58:12 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:58:12 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:58:12 user nova-compute[74646]:       <nova:owner>
Oct 26 15:58:12 user nova-compute[74646]:         <nova:user uuid="9311cee7c04e45ddbae6f16ba43eed2e">tempest-ServerActionsTestOtherA-333958340-project-member</nova:user>
Oct 26 15:58:12 user nova-compute[74646]:         <nova:project uuid="6c8788e95cc244f98b0ff8d593d1e067">tempest-ServerActionsTestOtherA-333958340</nova:project>
Oct 26 15:58:12 user nova-compute[74646]:       </nova:owner>
Oct 26 15:58:12 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:58:12 user nova-compute[74646]:       <nova:ports>
Oct 26 15:58:12 user nova-compute[74646]:         <nova:port uuid="c3fa2d89-235f-4939-8eff-e59c02c578fe">
Oct 26 15:58:12 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 15:58:12 user nova-compute[74646]:         </nova:port>
Oct 26 15:58:12 user nova-compute[74646]:       </nova:ports>
Oct 26 15:58:12 user nova-compute[74646]:     </nova:instance>
Oct 26 15:58:12 user nova-compute[74646]:   </metadata>
Oct 26 15:58:12 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:58:12 user nova-compute[74646]:     <system>
Oct 26 15:58:12 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:58:12 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:58:12 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:58:12 user nova-compute[74646]:       <entry name="serial">b79f5ea4-ea88-41b4-8ca2-116b5b6408de</entry>
Oct 26 15:58:12 user nova-compute[74646]:       <entry name="uuid">b79f5ea4-ea88-41b4-8ca2-116b5b6408de</entry>
Oct 26 15:58:12 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:58:12 user nova-compute[74646]:     </system>
Oct 26 15:58:12 user nova-compute[74646]:   </sysinfo>
Oct 26 15:58:12 user nova-compute[74646]:   <os>
Oct 26 15:58:12 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:58:12 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:58:12 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:58:12 user nova-compute[74646]:   </os>
Oct 26 15:58:12 user nova-compute[74646]:   <features>
Oct 26 15:58:12 user nova-compute[74646]:     <acpi/>
Oct 26 15:58:12 user nova-compute[74646]:     <apic/>
Oct 26 15:58:12 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:58:12 user nova-compute[74646]:   </features>
Oct 26 15:58:12 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:58:12 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:58:12 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:58:12 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:58:12 user nova-compute[74646]:   </clock>
Oct 26 15:58:12 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:58:12 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:58:12 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:58:12 user nova-compute[74646]:   </cpu>
Oct 26 15:58:12 user nova-compute[74646]:   <devices>
Oct 26 15:58:12 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:58:12 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:58:12 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk"/>
Oct 26 15:58:12 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:58:12 user nova-compute[74646]:     </disk>
Oct 26 15:58:12 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:58:12 user nova-compute[74646]:       <mac address="fa:16:3e:60:7f:15"/>
Oct 26 15:58:12 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:58:12 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:58:12 user nova-compute[74646]:       <target dev="tapc3fa2d89-23"/>
Oct 26 15:58:12 user nova-compute[74646]:     </interface>
Oct 26 15:58:12 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:58:12 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/console.log" append="off"/>
Oct 26 15:58:12 user nova-compute[74646]:     </serial>
Oct 26 15:58:12 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:58:12 user nova-compute[74646]:     <video>
Oct 26 15:58:12 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:58:12 user nova-compute[74646]:     </video>
Oct 26 15:58:12 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:58:12 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:58:12 user nova-compute[74646]:     </rng>
Oct 26 15:58:12 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:58:12 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:58:12 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:58:12 user nova-compute[74646]:     </memballoon>
Oct 26 15:58:12 user nova-compute[74646]:   </devices>
Oct 26 15:58:12 user nova-compute[74646]: </domain>
Oct 26 15:58:12 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-587138455',display_name='tempest-tempest.common.compute-instance-587138455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-587138455',id=20,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbmmCHSiAv6wnl4y6udIFIXZEW/bOp74proj1U5AEM0+QPtfownIPyTApMq9brABhT3IwnIfBs9QKjt04IQsymoSPOFRANJzeHzmMShY1+CCmigklKl+J5T9ZIigvKl+w==',key_name='tempest-keypair-1281352566',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-y115hib0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:58:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=b79f5ea4-ea88-41b4-8ca2-116b5b6408de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:60:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=c3fa2d89-235f-4939-8eff-e59c02c578fe,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fa2d89-23') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG os_vif [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=c3fa2d89-235f-4939-8eff-e59c02c578fe,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fa2d89-23') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0eafaa62-2c51-55df-ba0e-16d9466fafa5', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3fa2d89-23, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3fa2d89-23, col_values=(('qos', UUID('259d1510-14b0-4356-9dcd-64fa1f06f348')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3fa2d89-23, col_values=(('external_ids', {'iface-id': 'c3fa2d89-235f-4939-8eff-e59c02c578fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:7f:15', 'vm-uuid': 'b79f5ea4-ea88-41b4-8ca2-116b5b6408de'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:12 user nova-compute[74646]: INFO os_vif [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:60:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=c3fa2d89-235f-4939-8eff-e59c02c578fe,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fa2d89-23')
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] No VIF found with MAC fa:16:3e:60:7f:15, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Successfully updated port: 366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquired lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-3526e4ad-a4ce-4375-85e6-203726472381 req-fedb557c-863e-4456-acff-b7a8a403003e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received event network-changed-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-3526e4ad-a4ce-4375-85e6-203726472381 req-fedb557c-863e-4456-acff-b7a8a403003e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Refreshing instance network info cache due to event network-changed-366498f3-1228-49b7-b1cb-7c9c3b59423d. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3526e4ad-a4ce-4375-85e6-203726472381 req-fedb557c-863e-4456-acff-b7a8a403003e service nova] Acquiring lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-07e479ec-634e-4185-a0ca-6ddeb08fc915 req-71a439cd-7005-47a1-8092-0d0b9145f9c9 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Updated VIF entry in instance network info cache for port c3fa2d89-235f-4939-8eff-e59c02c578fe. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-07e479ec-634e-4185-a0ca-6ddeb08fc915 req-71a439cd-7005-47a1-8092-0d0b9145f9c9 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Updating instance_info_cache with network_info: [{"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:58:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-07e479ec-634e-4185-a0ca-6ddeb08fc915 req-71a439cd-7005-47a1-8092-0d0b9145f9c9 service nova] Releasing lock "refresh_cache-b79f5ea4-ea88-41b4-8ca2-116b5b6408de" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.network.neutron [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Updating instance_info_cache with network_info: [{"id": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "address": "fa:16:3e:1b:cc:e1", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap366498f3-12", "ovs_interfaceid": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Releasing lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.compute.manager [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Instance network_info: |[{"id": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "address": "fa:16:3e:1b:cc:e1", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap366498f3-12", "ovs_interfaceid": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3526e4ad-a4ce-4375-85e6-203726472381 req-fedb557c-863e-4456-acff-b7a8a403003e service nova] Acquired lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.network.neutron [req-3526e4ad-a4ce-4375-85e6-203726472381 req-fedb557c-863e-4456-acff-b7a8a403003e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Refreshing network info cache for port 366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Start _get_guest_xml network_info=[{"id": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "address": "fa:16:3e:1b:cc:e1", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap366498f3-12", "ovs_interfaceid": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:58:13 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:58:13 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-144059444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-144059444',id=21,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90e848952345455183c15fee816b6f12',ramdisk_id='',reservation_id='r-t1o4giqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-580785668',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:58:11Z,user_data=None,user_id='abd7a869c235467ca4da99867c6bc0d4',uuid=1283575f-b614-42d5-b632-c1409f295207,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "address": "fa:16:3e:1b:cc:e1", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap366498f3-12", "ovs_interfaceid": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converting VIF {"id": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "address": "fa:16:3e:1b:cc:e1", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap366498f3-12", "ovs_interfaceid": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:cc:e1,bridge_name='br-int',has_traffic_filtering=True,id=366498f3-1228-49b7-b1cb-7c9c3b59423d,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap366498f3-12') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.objects.instance [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'pci_devices' on Instance uuid 1283575f-b614-42d5-b632-c1409f295207 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:58:13 user nova-compute[74646]:   <uuid>1283575f-b614-42d5-b632-c1409f295207</uuid>
Oct 26 15:58:13 user nova-compute[74646]:   <name>instance-00000015</name>
Oct 26 15:58:13 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:58:13 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:58:13 user nova-compute[74646]:   <metadata>
Oct 26 15:58:13 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:58:13 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:58:13 user nova-compute[74646]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-144059444</nova:name>
Oct 26 15:58:13 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:58:13</nova:creationTime>
Oct 26 15:58:13 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:58:13 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:58:13 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:58:13 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:58:13 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:58:13 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:58:13 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:58:13 user nova-compute[74646]:       <nova:owner>
Oct 26 15:58:13 user nova-compute[74646]:         <nova:user uuid="abd7a869c235467ca4da99867c6bc0d4">tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member</nova:user>
Oct 26 15:58:13 user nova-compute[74646]:         <nova:project uuid="90e848952345455183c15fee816b6f12">tempest-ServerBootFromVolumeStableRescueTest-580785668</nova:project>
Oct 26 15:58:13 user nova-compute[74646]:       </nova:owner>
Oct 26 15:58:13 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:58:13 user nova-compute[74646]:       <nova:ports>
Oct 26 15:58:13 user nova-compute[74646]:         <nova:port uuid="366498f3-1228-49b7-b1cb-7c9c3b59423d">
Oct 26 15:58:13 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 15:58:13 user nova-compute[74646]:         </nova:port>
Oct 26 15:58:13 user nova-compute[74646]:       </nova:ports>
Oct 26 15:58:13 user nova-compute[74646]:     </nova:instance>
Oct 26 15:58:13 user nova-compute[74646]:   </metadata>
Oct 26 15:58:13 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:58:13 user nova-compute[74646]:     <system>
Oct 26 15:58:13 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:58:13 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:58:13 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:58:13 user nova-compute[74646]:       <entry name="serial">1283575f-b614-42d5-b632-c1409f295207</entry>
Oct 26 15:58:13 user nova-compute[74646]:       <entry name="uuid">1283575f-b614-42d5-b632-c1409f295207</entry>
Oct 26 15:58:13 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:58:13 user nova-compute[74646]:     </system>
Oct 26 15:58:13 user nova-compute[74646]:   </sysinfo>
Oct 26 15:58:13 user nova-compute[74646]:   <os>
Oct 26 15:58:13 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:58:13 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:58:13 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:58:13 user nova-compute[74646]:   </os>
Oct 26 15:58:13 user nova-compute[74646]:   <features>
Oct 26 15:58:13 user nova-compute[74646]:     <acpi/>
Oct 26 15:58:13 user nova-compute[74646]:     <apic/>
Oct 26 15:58:13 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:58:13 user nova-compute[74646]:   </features>
Oct 26 15:58:13 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:58:13 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:58:13 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:58:13 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:58:13 user nova-compute[74646]:   </clock>
Oct 26 15:58:13 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:58:13 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:58:13 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:58:13 user nova-compute[74646]:   </cpu>
Oct 26 15:58:13 user nova-compute[74646]:   <devices>
Oct 26 15:58:13 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:58:13 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:58:13 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk"/>
Oct 26 15:58:13 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:58:13 user nova-compute[74646]:     </disk>
Oct 26 15:58:13 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:58:13 user nova-compute[74646]:       <mac address="fa:16:3e:1b:cc:e1"/>
Oct 26 15:58:13 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:58:13 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:58:13 user nova-compute[74646]:       <target dev="tap366498f3-12"/>
Oct 26 15:58:13 user nova-compute[74646]:     </interface>
Oct 26 15:58:13 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:58:13 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/console.log" append="off"/>
Oct 26 15:58:13 user nova-compute[74646]:     </serial>
Oct 26 15:58:13 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:58:13 user nova-compute[74646]:     <video>
Oct 26 15:58:13 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:58:13 user nova-compute[74646]:     </video>
Oct 26 15:58:13 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:58:13 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:58:13 user nova-compute[74646]:     </rng>
Oct 26 15:58:13 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:58:13 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:58:13 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:58:13 user nova-compute[74646]:     </memballoon>
Oct 26 15:58:13 user nova-compute[74646]:   </devices>
Oct 26 15:58:13 user nova-compute[74646]: </domain>
Oct 26 15:58:13 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-144059444',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-144059444',id=21,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90e848952345455183c15fee816b6f12',ramdisk_id='',reservation_id='r-t1o4giqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-580785668',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:58:11Z,user_data=None,user_id='abd7a869c235467ca4da99867c6bc0d4',uuid=1283575f-b614-42d5-b632-c1409f295207,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "address": "fa:16:3e:1b:cc:e1", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap366498f3-12", "ovs_interfaceid": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converting VIF {"id": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "address": "fa:16:3e:1b:cc:e1", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap366498f3-12", "ovs_interfaceid": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:cc:e1,bridge_name='br-int',has_traffic_filtering=True,id=366498f3-1228-49b7-b1cb-7c9c3b59423d,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap366498f3-12') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG os_vif [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:cc:e1,bridge_name='br-int',has_traffic_filtering=True,id=366498f3-1228-49b7-b1cb-7c9c3b59423d,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap366498f3-12') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68927f2c-3581-5c4d-8448-605f13c203e6', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap366498f3-12, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap366498f3-12, col_values=(('qos', UUID('b8101557-fc6e-4774-9ff6-456c11307684')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap366498f3-12, col_values=(('external_ids', {'iface-id': '366498f3-1228-49b7-b1cb-7c9c3b59423d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:cc:e1', 'vm-uuid': '1283575f-b614-42d5-b632-c1409f295207'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:13 user nova-compute[74646]: INFO os_vif [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:cc:e1,bridge_name='br-int',has_traffic_filtering=True,id=366498f3-1228-49b7-b1cb-7c9c3b59423d,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap366498f3-12')
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] No VIF found with MAC fa:16:3e:1b:cc:e1, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.objects.instance [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lazy-loading 'flavor' on Instance uuid 5fbfcaaa-f050-473e-9e59-e48179a606e2 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-12e15482-aa6d-4f05-8934-0820f828299f tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.917s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.network.neutron [req-3526e4ad-a4ce-4375-85e6-203726472381 req-fedb557c-863e-4456-acff-b7a8a403003e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Updated VIF entry in instance network info cache for port 366498f3-1228-49b7-b1cb-7c9c3b59423d. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG nova.network.neutron [req-3526e4ad-a4ce-4375-85e6-203726472381 req-fedb557c-863e-4456-acff-b7a8a403003e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Updating instance_info_cache with network_info: [{"id": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "address": "fa:16:3e:1b:cc:e1", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap366498f3-12", "ovs_interfaceid": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3526e4ad-a4ce-4375-85e6-203726472381 req-fedb557c-863e-4456-acff-b7a8a403003e service nova] Releasing lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:13 user nova-compute[74646]: INFO nova.compute.manager [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Detaching volume f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0
Oct 26 15:58:14 user nova-compute[74646]: INFO nova.virt.block_device [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Attempting to driver detach volume f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 from mountpoint /dev/vdc
Oct 26 15:58:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Attempting to detach device vdc from instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 15:58:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 15:58:14 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:58:14 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 15:58:14 user nova-compute[74646]:   <target dev="vdc" bus="virtio"/>
Oct 26 15:58:14 user nova-compute[74646]:   <serial>f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0</serial>
Oct 26 15:58:14 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 15:58:14 user nova-compute[74646]: </disk>
Oct 26 15:58:14 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:58:14 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Successfully detached device vdc from instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 from the persistent domain config.
Oct 26 15:58:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 15:58:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 15:58:14 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:58:14 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 15:58:14 user nova-compute[74646]:   <target dev="vdc" bus="virtio"/>
Oct 26 15:58:14 user nova-compute[74646]:   <serial>f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0</serial>
Oct 26 15:58:14 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 15:58:14 user nova-compute[74646]: </disk>
Oct 26 15:58:14 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:58:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:14 user nova-compute[74646]: DEBUG nova.compute.manager [req-c192981b-1ce4-4da8-af48-fc2d05b5d024 req-2a7a846a-bdfb-4cca-9a38-d3bcb8e4a055 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received event network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:58:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c192981b-1ce4-4da8-af48-fc2d05b5d024 req-2a7a846a-bdfb-4cca-9a38-d3bcb8e4a055 service nova] Acquiring lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c192981b-1ce4-4da8-af48-fc2d05b5d024 req-2a7a846a-bdfb-4cca-9a38-d3bcb8e4a055 service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c192981b-1ce4-4da8-af48-fc2d05b5d024 req-2a7a846a-bdfb-4cca-9a38-d3bcb8e4a055 service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:14 user nova-compute[74646]: DEBUG nova.compute.manager [req-c192981b-1ce4-4da8-af48-fc2d05b5d024 req-2a7a846a-bdfb-4cca-9a38-d3bcb8e4a055 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] No waiting events found dispatching network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:58:14 user nova-compute[74646]: WARNING nova.compute.manager [req-c192981b-1ce4-4da8-af48-fc2d05b5d024 req-2a7a846a-bdfb-4cca-9a38-d3bcb8e4a055 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received unexpected event network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe for instance with vm_state building and task_state spawning.
Oct 26 15:58:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 15:58:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBQdHkOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:58:15 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:58:15 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:58:15 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0773154-a8c0-4028-ab50-9af015a5a5e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:58:15 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdd5b5a-e79b-4e3b-b33a-1eabde0b8fae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634] added
Oct 26 15:58:15 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d171219-c422-42da-96e6-661ac7b3ae05]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d0e0b2-7118-4716-85f4-8585f3db1ad6]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IBQdHkOr {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IBQdHkOr" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d86dcb-e072-4f2d-96fd-dd3d587cbd8d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IBQdHkOr'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa10a9d-8407-49b8-9278-9dfe67759aca]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[28433746-aff4-4718-9032-e45f96273cac]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)
Oct 26 15:58:15 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)
Oct 26 15:58:15 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad769552-4b30-4f2f-8ae2-c2249d545d50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634, portal: 172.16.0.220,3260]
Oct 26 15:58:15 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634, portal: 172.16.0.220,3260] successful.
Oct 26 15:58:15 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1271eeb-e237-4ae6-843c-4d1658a6726d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f360fcd6-121e-40d1-8b0b-fca8f82a8768]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)
Oct 26 15:58:15 user nova-compute[74646]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 (non-flash)
Oct 26 15:58:15 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)
Oct 26 15:58:15 user nova-compute[74646]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 (non-flash)
Oct 26 15:58:15 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b152825-31e9-4add-b095-16e5d53e8072]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:58:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBQdHkOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG nova.compute.manager [req-7e14cea9-ddef-46c5-991a-e10447db8401 req-0d7e991a-4329-4b81-808b-4d3492b7c875 service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received event network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7e14cea9-ddef-46c5-991a-e10447db8401 req-0d7e991a-4329-4b81-808b-4d3492b7c875 service nova] Acquiring lock "1283575f-b614-42d5-b632-c1409f295207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7e14cea9-ddef-46c5-991a-e10447db8401 req-0d7e991a-4329-4b81-808b-4d3492b7c875 service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7e14cea9-ddef-46c5-991a-e10447db8401 req-0d7e991a-4329-4b81-808b-4d3492b7c875 service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG nova.compute.manager [req-7e14cea9-ddef-46c5-991a-e10447db8401 req-0d7e991a-4329-4b81-808b-4d3492b7c875 service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] No waiting events found dispatching network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:58:16 user nova-compute[74646]: WARNING nova.compute.manager [req-7e14cea9-ddef-46c5-991a-e10447db8401 req-0d7e991a-4329-4b81-808b-4d3492b7c875 service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received unexpected event network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d for instance with vm_state building and task_state spawning.
Oct 26 15:58:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23162346537313763', 'path': '/dev/sdb'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23162346537313763', 'path': '/dev/sdb'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG nova.objects.instance [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lazy-loading 'flavor' on Instance uuid 65393333-197f-400e-89b5-7438f5697169 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG nova.compute.manager [req-9ae794ea-5072-4fc3-863b-01552a780dee req-bf7f97b3-f300-4e8b-a77f-d88489202ada service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received event network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9ae794ea-5072-4fc3-863b-01552a780dee req-bf7f97b3-f300-4e8b-a77f-d88489202ada service nova] Acquiring lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9ae794ea-5072-4fc3-863b-01552a780dee req-bf7f97b3-f300-4e8b-a77f-d88489202ada service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9ae794ea-5072-4fc3-863b-01552a780dee req-bf7f97b3-f300-4e8b-a77f-d88489202ada service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG nova.compute.manager [req-9ae794ea-5072-4fc3-863b-01552a780dee req-bf7f97b3-f300-4e8b-a77f-d88489202ada service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] No waiting events found dispatching network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:58:16 user nova-compute[74646]: WARNING nova.compute.manager [req-9ae794ea-5072-4fc3-863b-01552a780dee req-bf7f97b3-f300-4e8b-a77f-d88489202ada service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received unexpected event network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe for instance with vm_state building and task_state spawning.
Oct 26 15:58:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 15:58:16 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:58:16 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 15:58:16 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:58:16 user nova-compute[74646]:   <serial>b7b752eb-7344-408e-8ae3-8980db762634</serial>
Oct 26 15:58:16 user nova-compute[74646]: </disk>
Oct 26 15:58:16 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:58:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:58:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] No VIF found with MAC fa:16:3e:1c:80:7c, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:58:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f06f7667-3449-4960-9f29-18c30f1a9a37 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "65393333-197f-400e-89b5-7438f5697169" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.486s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:58:18 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Instance spawned successfully.
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:58:18 user nova-compute[74646]: INFO nova.compute.manager [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Took 8.12 seconds to spawn the instance on the hypervisor.
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.compute.manager [req-ded540ee-9e89-4890-91dc-4eeeaa8ddd69 req-9f7e0905-1381-4e73-be17-98e21b26f144 service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received event network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ded540ee-9e89-4890-91dc-4eeeaa8ddd69 req-9f7e0905-1381-4e73-be17-98e21b26f144 service nova] Acquiring lock "1283575f-b614-42d5-b632-c1409f295207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ded540ee-9e89-4890-91dc-4eeeaa8ddd69 req-9f7e0905-1381-4e73-be17-98e21b26f144 service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ded540ee-9e89-4890-91dc-4eeeaa8ddd69 req-9f7e0905-1381-4e73-be17-98e21b26f144 service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.compute.manager [req-ded540ee-9e89-4890-91dc-4eeeaa8ddd69 req-9f7e0905-1381-4e73-be17-98e21b26f144 service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] No waiting events found dispatching network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:58:18 user nova-compute[74646]: WARNING nova.compute.manager [req-ded540ee-9e89-4890-91dc-4eeeaa8ddd69 req-9f7e0905-1381-4e73-be17-98e21b26f144 service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received unexpected event network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d for instance with vm_state building and task_state spawning.
Oct 26 15:58:18 user nova-compute[74646]: INFO nova.compute.manager [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Took 9.34 seconds to build instance.
Oct 26 15:58:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-d765d5b4-dde8-4d43-9c88-f81b2ddae7df tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.467s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.compute.manager [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:58:18 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 1283575f-b614-42d5-b632-c1409f295207] Instance spawned successfully.
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:18 user nova-compute[74646]: INFO nova.compute.manager [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Took 7.93 seconds to spawn the instance on the hypervisor.
Oct 26 15:58:18 user nova-compute[74646]: DEBUG nova.compute.manager [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:58:18 user nova-compute[74646]: INFO nova.compute.manager [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Took 9.60 seconds to build instance.
Oct 26 15:58:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-312df6e9-4754-4e8b-84d9-bff088949534 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "1283575f-b614-42d5-b632-c1409f295207" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.728s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:58:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:58:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:58:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:58:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:19 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:58:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:58:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.296s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:25 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:58:25 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7745MB free_disk=25.500492095947266GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2b514455-44b2-4115-bb13-38ba1713a263 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 96a71d00-27f0-4dbe-88cb-e6f296178e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 65393333-197f-400e-89b5-7438f5697169 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 51088a91-dc4a-467c-8f35-3c85a9ddd3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:58:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.623s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:26 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 15:58:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:26 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:58:26 user nova-compute[74646]: INFO nova.compute.claims [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Claim successful on node user
Oct 26 15:58:27 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 15:58:27 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 15:58:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG nova.policy [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '05a35d09461745e1a1250ecdc2443a75', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e1515df0bbff42d5be9f8ba40cdeb0da', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 15:58:27 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Creating image(s)
Oct 26 15:58:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "/opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "/opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-5fbfcaaa-f050-473e-9e59-e48179a606e2" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-5fbfcaaa-f050-473e-9e59-e48179a606e2" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.263s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.225s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk 1073741824" returned: 0 in 0.076s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.308s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Successfully created port: d81f29ee-8954-4306-ad39-9634dd9c85af {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.280s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Updating instance_info_cache with network_info: [{"id": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "address": "fa:16:3e:10:ee:9c", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff1d7189-17", "ovs_interfaceid": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-5fbfcaaa-f050-473e-9e59-e48179a606e2" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Cannot resize image /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Ensure instance console log exists: /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Successfully updated port: d81f29ee-8954-4306-ad39-9634dd9c85af {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "refresh_cache-ac760a1e-ead6-4a6f-90d0-0ecd10d7c600" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquired lock "refresh_cache-ac760a1e-ead6-4a6f-90d0-0ecd10d7c600" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-3ad25e6d-d247-4efe-9fe6-602cbfc7b176 req-477727b4-235b-4be9-a36b-bc339c1a5e58 service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Received event network-changed-d81f29ee-8954-4306-ad39-9634dd9c85af {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-3ad25e6d-d247-4efe-9fe6-602cbfc7b176 req-477727b4-235b-4be9-a36b-bc339c1a5e58 service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Refreshing instance network info cache due to event network-changed-d81f29ee-8954-4306-ad39-9634dd9c85af. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3ad25e6d-d247-4efe-9fe6-602cbfc7b176 req-477727b4-235b-4be9-a36b-bc339c1a5e58 service nova] Acquiring lock "refresh_cache-ac760a1e-ead6-4a6f-90d0-0ecd10d7c600" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Updating instance_info_cache with network_info: [{"id": "d81f29ee-8954-4306-ad39-9634dd9c85af", "address": "fa:16:3e:19:1d:b3", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81f29ee-89", "ovs_interfaceid": "d81f29ee-8954-4306-ad39-9634dd9c85af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Releasing lock "refresh_cache-ac760a1e-ead6-4a6f-90d0-0ecd10d7c600" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Instance network_info: |[{"id": "d81f29ee-8954-4306-ad39-9634dd9c85af", "address": "fa:16:3e:19:1d:b3", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81f29ee-89", "ovs_interfaceid": "d81f29ee-8954-4306-ad39-9634dd9c85af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3ad25e6d-d247-4efe-9fe6-602cbfc7b176 req-477727b4-235b-4be9-a36b-bc339c1a5e58 service nova] Acquired lock "refresh_cache-ac760a1e-ead6-4a6f-90d0-0ecd10d7c600" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.network.neutron [req-3ad25e6d-d247-4efe-9fe6-602cbfc7b176 req-477727b4-235b-4be9-a36b-bc339c1a5e58 service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Refreshing network info cache for port d81f29ee-8954-4306-ad39-9634dd9c85af {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Start _get_guest_xml network_info=[{"id": "d81f29ee-8954-4306-ad39-9634dd9c85af", "address": "fa:16:3e:19:1d:b3", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81f29ee-89", "ovs_interfaceid": "d81f29ee-8954-4306-ad39-9634dd9c85af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 15:58:29 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:58:29 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2007043401',display_name='tempest-VolumesAdminNegativeTest-server-2007043401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2007043401',id=22,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1515df0bbff42d5be9f8ba40cdeb0da',ramdisk_id='',reservation_id='r-vbwziaxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-464290099',owner_user_name='tempest-VolumesAdminNegativeTest-464290099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:58:28Z,user_data=None,user_id='05a35d09461745e1a1250ecdc2443a75',uuid=ac760a1e-ead6-4a6f-90d0-0ecd10d7c600,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d81f29ee-8954-4306-ad39-9634dd9c85af", "address": "fa:16:3e:19:1d:b3", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81f29ee-89", "ovs_interfaceid": "d81f29ee-8954-4306-ad39-9634dd9c85af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Converting VIF {"id": "d81f29ee-8954-4306-ad39-9634dd9c85af", "address": "fa:16:3e:19:1d:b3", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81f29ee-89", "ovs_interfaceid": "d81f29ee-8954-4306-ad39-9634dd9c85af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:1d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d81f29ee-8954-4306-ad39-9634dd9c85af,network=Network(a23d40dd-77c0-4375-b256-1c5a6caa93ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81f29ee-89') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.objects.instance [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lazy-loading 'pci_devices' on Instance uuid ac760a1e-ead6-4a6f-90d0-0ecd10d7c600 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] End _get_guest_xml xml=<domain type="kvm">
Oct 26 15:58:29 user nova-compute[74646]:   <uuid>ac760a1e-ead6-4a6f-90d0-0ecd10d7c600</uuid>
Oct 26 15:58:29 user nova-compute[74646]:   <name>instance-00000016</name>
Oct 26 15:58:29 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 15:58:29 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 15:58:29 user nova-compute[74646]:   <metadata>
Oct 26 15:58:29 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 15:58:29 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 15:58:29 user nova-compute[74646]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2007043401</nova:name>
Oct 26 15:58:29 user nova-compute[74646]:       <nova:creationTime>2023-10-26 15:58:29</nova:creationTime>
Oct 26 15:58:29 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 15:58:29 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 15:58:29 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 15:58:29 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 15:58:29 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 15:58:29 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 15:58:29 user nova-compute[74646]:       </nova:flavor>
Oct 26 15:58:29 user nova-compute[74646]:       <nova:owner>
Oct 26 15:58:29 user nova-compute[74646]:         <nova:user uuid="05a35d09461745e1a1250ecdc2443a75">tempest-VolumesAdminNegativeTest-464290099-project-member</nova:user>
Oct 26 15:58:29 user nova-compute[74646]:         <nova:project uuid="e1515df0bbff42d5be9f8ba40cdeb0da">tempest-VolumesAdminNegativeTest-464290099</nova:project>
Oct 26 15:58:29 user nova-compute[74646]:       </nova:owner>
Oct 26 15:58:29 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 15:58:29 user nova-compute[74646]:       <nova:ports>
Oct 26 15:58:29 user nova-compute[74646]:         <nova:port uuid="d81f29ee-8954-4306-ad39-9634dd9c85af">
Oct 26 15:58:29 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 15:58:29 user nova-compute[74646]:         </nova:port>
Oct 26 15:58:29 user nova-compute[74646]:       </nova:ports>
Oct 26 15:58:29 user nova-compute[74646]:     </nova:instance>
Oct 26 15:58:29 user nova-compute[74646]:   </metadata>
Oct 26 15:58:29 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 15:58:29 user nova-compute[74646]:     <system>
Oct 26 15:58:29 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 15:58:29 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 15:58:29 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 15:58:29 user nova-compute[74646]:       <entry name="serial">ac760a1e-ead6-4a6f-90d0-0ecd10d7c600</entry>
Oct 26 15:58:29 user nova-compute[74646]:       <entry name="uuid">ac760a1e-ead6-4a6f-90d0-0ecd10d7c600</entry>
Oct 26 15:58:29 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 15:58:29 user nova-compute[74646]:     </system>
Oct 26 15:58:29 user nova-compute[74646]:   </sysinfo>
Oct 26 15:58:29 user nova-compute[74646]:   <os>
Oct 26 15:58:29 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 15:58:29 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 15:58:29 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 15:58:29 user nova-compute[74646]:   </os>
Oct 26 15:58:29 user nova-compute[74646]:   <features>
Oct 26 15:58:29 user nova-compute[74646]:     <acpi/>
Oct 26 15:58:29 user nova-compute[74646]:     <apic/>
Oct 26 15:58:29 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 15:58:29 user nova-compute[74646]:   </features>
Oct 26 15:58:29 user nova-compute[74646]:   <clock offset="utc">
Oct 26 15:58:29 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 15:58:29 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 15:58:29 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 15:58:29 user nova-compute[74646]:   </clock>
Oct 26 15:58:29 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 15:58:29 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 15:58:29 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 15:58:29 user nova-compute[74646]:   </cpu>
Oct 26 15:58:29 user nova-compute[74646]:   <devices>
Oct 26 15:58:29 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 15:58:29 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 15:58:29 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk"/>
Oct 26 15:58:29 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 15:58:29 user nova-compute[74646]:     </disk>
Oct 26 15:58:29 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 15:58:29 user nova-compute[74646]:       <mac address="fa:16:3e:19:1d:b3"/>
Oct 26 15:58:29 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:58:29 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 15:58:29 user nova-compute[74646]:       <target dev="tapd81f29ee-89"/>
Oct 26 15:58:29 user nova-compute[74646]:     </interface>
Oct 26 15:58:29 user nova-compute[74646]:     <serial type="pty">
Oct 26 15:58:29 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/console.log" append="off"/>
Oct 26 15:58:29 user nova-compute[74646]:     </serial>
Oct 26 15:58:29 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 15:58:29 user nova-compute[74646]:     <video>
Oct 26 15:58:29 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 15:58:29 user nova-compute[74646]:     </video>
Oct 26 15:58:29 user nova-compute[74646]:     <rng model="virtio">
Oct 26 15:58:29 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 15:58:29 user nova-compute[74646]:     </rng>
Oct 26 15:58:29 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 15:58:29 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 15:58:29 user nova-compute[74646]:       <stats period="10"/>
Oct 26 15:58:29 user nova-compute[74646]:     </memballoon>
Oct 26 15:58:29 user nova-compute[74646]:   </devices>
Oct 26 15:58:29 user nova-compute[74646]: </domain>
Oct 26 15:58:29 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2007043401',display_name='tempest-VolumesAdminNegativeTest-server-2007043401',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2007043401',id=22,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e1515df0bbff42d5be9f8ba40cdeb0da',ramdisk_id='',reservation_id='r-vbwziaxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-464290099',owner_user_name='tempest-VolumesAdminNegativeTest-464290099-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:58:28Z,user_data=None,user_id='05a35d09461745e1a1250ecdc2443a75',uuid=ac760a1e-ead6-4a6f-90d0-0ecd10d7c600,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d81f29ee-8954-4306-ad39-9634dd9c85af", "address": "fa:16:3e:19:1d:b3", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81f29ee-89", "ovs_interfaceid": "d81f29ee-8954-4306-ad39-9634dd9c85af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Converting VIF {"id": "d81f29ee-8954-4306-ad39-9634dd9c85af", "address": "fa:16:3e:19:1d:b3", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81f29ee-89", "ovs_interfaceid": "d81f29ee-8954-4306-ad39-9634dd9c85af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:1d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d81f29ee-8954-4306-ad39-9634dd9c85af,network=Network(a23d40dd-77c0-4375-b256-1c5a6caa93ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81f29ee-89') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG os_vif [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:1d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d81f29ee-8954-4306-ad39-9634dd9c85af,network=Network(a23d40dd-77c0-4375-b256-1c5a6caa93ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81f29ee-89') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1147ae14-79b1-50fd-89b6-ff140801e246', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd81f29ee-89, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd81f29ee-89, col_values=(('qos', UUID('a370d37d-7d05-421f-be95-504d31090d4e')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd81f29ee-89, col_values=(('external_ids', {'iface-id': 'd81f29ee-8954-4306-ad39-9634dd9c85af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:1d:b3', 'vm-uuid': 'ac760a1e-ead6-4a6f-90d0-0ecd10d7c600'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:58:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:29 user nova-compute[74646]: INFO os_vif [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:1d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d81f29ee-8954-4306-ad39-9634dd9c85af,network=Network(a23d40dd-77c0-4375-b256-1c5a6caa93ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81f29ee-89')
Oct 26 15:58:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:58:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] No VIF found with MAC fa:16:3e:19:1d:b3, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:58:30 user nova-compute[74646]: DEBUG nova.network.neutron [req-3ad25e6d-d247-4efe-9fe6-602cbfc7b176 req-477727b4-235b-4be9-a36b-bc339c1a5e58 service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Updated VIF entry in instance network info cache for port d81f29ee-8954-4306-ad39-9634dd9c85af. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:58:30 user nova-compute[74646]: DEBUG nova.network.neutron [req-3ad25e6d-d247-4efe-9fe6-602cbfc7b176 req-477727b4-235b-4be9-a36b-bc339c1a5e58 service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Updating instance_info_cache with network_info: [{"id": "d81f29ee-8954-4306-ad39-9634dd9c85af", "address": "fa:16:3e:19:1d:b3", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81f29ee-89", "ovs_interfaceid": "d81f29ee-8954-4306-ad39-9634dd9c85af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:58:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3ad25e6d-d247-4efe-9fe6-602cbfc7b176 req-477727b4-235b-4be9-a36b-bc339c1a5e58 service nova] Releasing lock "refresh_cache-ac760a1e-ead6-4a6f-90d0-0ecd10d7c600" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:58:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:31 user nova-compute[74646]: DEBUG nova.compute.manager [req-d742afb8-b751-4d78-bf42-f821acbafedf req-196ceed4-333b-4275-b2a8-5b681aabdefa service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Received event network-vif-plugged-d81f29ee-8954-4306-ad39-9634dd9c85af {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:58:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d742afb8-b751-4d78-bf42-f821acbafedf req-196ceed4-333b-4275-b2a8-5b681aabdefa service nova] Acquiring lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d742afb8-b751-4d78-bf42-f821acbafedf req-196ceed4-333b-4275-b2a8-5b681aabdefa service nova] Lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.009s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d742afb8-b751-4d78-bf42-f821acbafedf req-196ceed4-333b-4275-b2a8-5b681aabdefa service nova] Lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:31 user nova-compute[74646]: DEBUG nova.compute.manager [req-d742afb8-b751-4d78-bf42-f821acbafedf req-196ceed4-333b-4275-b2a8-5b681aabdefa service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] No waiting events found dispatching network-vif-plugged-d81f29ee-8954-4306-ad39-9634dd9c85af {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:58:31 user nova-compute[74646]: WARNING nova.compute.manager [req-d742afb8-b751-4d78-bf42-f821acbafedf req-196ceed4-333b-4275-b2a8-5b681aabdefa service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Received unexpected event network-vif-plugged-d81f29ee-8954-4306-ad39-9634dd9c85af for instance with vm_state building and task_state spawning.
Oct 26 15:58:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-985d17c1-e0bc-437d-8c3d-ae98b56c4546 req-5b7b6213-b37c-4173-bf68-467f56a2285f service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Received event network-vif-plugged-d81f29ee-8954-4306-ad39-9634dd9c85af {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:58:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-985d17c1-e0bc-437d-8c3d-ae98b56c4546 req-5b7b6213-b37c-4173-bf68-467f56a2285f service nova] Acquiring lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-985d17c1-e0bc-437d-8c3d-ae98b56c4546 req-5b7b6213-b37c-4173-bf68-467f56a2285f service nova] Lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-985d17c1-e0bc-437d-8c3d-ae98b56c4546 req-5b7b6213-b37c-4173-bf68-467f56a2285f service nova] Lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-985d17c1-e0bc-437d-8c3d-ae98b56c4546 req-5b7b6213-b37c-4173-bf68-467f56a2285f service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] No waiting events found dispatching network-vif-plugged-d81f29ee-8954-4306-ad39-9634dd9c85af {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:58:33 user nova-compute[74646]: WARNING nova.compute.manager [req-985d17c1-e0bc-437d-8c3d-ae98b56c4546 req-5b7b6213-b37c-4173-bf68-467f56a2285f service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Received unexpected event network-vif-plugged-d81f29ee-8954-4306-ad39-9634dd9c85af for instance with vm_state building and task_state spawning.
Oct 26 15:58:33 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 15:58:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 15:58:33 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Instance spawned successfully.
Oct 26 15:58:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 15:58:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 15:58:33 user nova-compute[74646]: INFO nova.compute.manager [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Took 6.34 seconds to spawn the instance on the hypervisor.
Oct 26 15:58:33 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 15:58:34 user nova-compute[74646]: INFO nova.compute.manager [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Took 7.38 seconds to build instance.
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ca8b2ae3-4dcd-491b-97f4-377a69cdf83f tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.540s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:34 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 is timed out.
Oct 26 15:58:34 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Successfully detached device vdc from instance 5fbfcaaa-f050-473e-9e59-e48179a606e2 from the live domain config.
Oct 26 15:58:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zZUunjhp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:58:34 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21d691e-1157-45bf-bc88-24b0055e4a08]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:58:34 user nova-compute[74646]: No targets found.
Oct 26 15:58:34 user nova-compute[74646]: iSNS:
Oct 26 15:58:34 user nova-compute[74646]: No targets found.
Oct 26 15:58:34 user nova-compute[74646]: STATIC:
Oct 26 15:58:34 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0
Oct 26 15:58:34 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:58:34 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:58:34 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634
Oct 26 15:58:34 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:58:34 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:58:34 user nova-compute[74646]: FIRMWARE:
Oct 26 15:58:34 user nova-compute[74646]: No targets found.
Oct 26 15:58:34 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:58:34 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:58:34 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ca481b-0160-4846-a4e9-835eb40d7d97]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[614c7e74-0d91-4584-b868-2609a81d7953]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)
Oct 26 15:58:34 user nova-compute[74646]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 (non-flash)
Oct 26 15:58:34 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 (non-flash)
Oct 26 15:58:34 user nova-compute[74646]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 (non-flash)
Oct 26 15:58:34 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e82e4ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0'): ({'sdd'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Removing single pathed devices sdd {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebd9a22-1635-445d-9b89-d2fad3720aed]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ed3d66-0d57-4672-bcb7-531b9862cfe7]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Flushing IO for device /dev/sdd {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f71ee5-1c19-474e-883e-b5f236fda648]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0010a4-0fab-40a5-9807-030b005676ad]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b56fb29-1718-47c1-b981-dbae6606a422]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:58:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b38e489b-7038-4319-930b-4076819aa9ba]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0, portal: 172.16.0.220,3260]
Oct 26 15:58:35 user nova-compute[74646]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0, portal: 172.16.0.220,3260] successful.
Oct 26 15:58:35 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:58:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:58:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5deb39b-14f2-47ac-8cc6-c3a9a32b44f0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:58:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5681c883-7f37-44d0-a908-b9f5b26ba7bb]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:58:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:58:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:58:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] <== disconnect_volume: return (323ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:58:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:58:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:35 user nova-compute[74646]: DEBUG nova.objects.instance [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lazy-loading 'flavor' on Instance uuid 5fbfcaaa-f050-473e-9e59-e48179a606e2 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:58:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-980019ad-063f-4879-adb5-6aded2082e6c tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.043s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:37 user nova-compute[74646]: INFO nova.compute.manager [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Terminating instance
Oct 26 15:58:37 user nova-compute[74646]: DEBUG nova.compute.manager [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-24af3279-58d9-4785-96da-54d9a565d801 req-0e037716-c82e-4370-9c95-df814a6a939f service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Received event network-vif-unplugged-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-24af3279-58d9-4785-96da-54d9a565d801 req-0e037716-c82e-4370-9c95-df814a6a939f service nova] Acquiring lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-24af3279-58d9-4785-96da-54d9a565d801 req-0e037716-c82e-4370-9c95-df814a6a939f service nova] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-24af3279-58d9-4785-96da-54d9a565d801 req-0e037716-c82e-4370-9c95-df814a6a939f service nova] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-24af3279-58d9-4785-96da-54d9a565d801 req-0e037716-c82e-4370-9c95-df814a6a939f service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] No waiting events found dispatching network-vif-unplugged-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:58:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-24af3279-58d9-4785-96da-54d9a565d801 req-0e037716-c82e-4370-9c95-df814a6a939f service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Received event network-vif-unplugged-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:58:38 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Instance destroyed successfully.
Oct 26 15:58:38 user nova-compute[74646]: DEBUG nova.objects.instance [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lazy-loading 'resources' on Instance uuid 5fbfcaaa-f050-473e-9e59-e48179a606e2 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:58:38 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:54:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-781379095',display_name='tempest-AttachVolumeTestJSON-server-781379095',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-781379095',id=14,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNsXQE453uK0lLzjrYlR4DLEizoib5xh9odwhhyi+ohkUe1oujptzPPw6adTebnGGiKqHM3dtwPDy4kAxfTD8Zah+cdnpNCgYmPFZST5FAVpalPjLDvSFyjyrTpQboGUmA==',key_name='tempest-keypair-1651792393',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:54:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5888676639c54df88e50f01bf81d3cb8',ramdisk_id='',reservation_id='r-rfs5tpgc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1526735619',owner_user_name='tempest-AttachVolumeTestJSON-1526735619-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:54:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='18f080f51ac04c23a489e5dc115a1ba1',uuid=5fbfcaaa-f050-473e-9e59-e48179a606e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "address": "fa:16:3e:10:ee:9c", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff1d7189-17", "ovs_interfaceid": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:58:38 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Converting VIF {"id": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "address": "fa:16:3e:10:ee:9c", "network": {"id": "4a154aa2-0773-459f-b145-b76412506085", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1946212367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5888676639c54df88e50f01bf81d3cb8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff1d7189-17", "ovs_interfaceid": "ff1d7189-1721-4f3b-9c25-2aa8f71d9577", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:58:38 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:ee:9c,bridge_name='br-int',has_traffic_filtering=True,id=ff1d7189-1721-4f3b-9c25-2aa8f71d9577,network=Network(4a154aa2-0773-459f-b145-b76412506085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff1d7189-17') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:58:38 user nova-compute[74646]: DEBUG os_vif [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:ee:9c,bridge_name='br-int',has_traffic_filtering=True,id=ff1d7189-1721-4f3b-9c25-2aa8f71d9577,network=Network(4a154aa2-0773-459f-b145-b76412506085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff1d7189-17') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:58:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff1d7189-17, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:58:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b58bac09-1ab0-4c7b-9670-5d1230459932) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:58:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:58:38 user nova-compute[74646]: INFO os_vif [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:ee:9c,bridge_name='br-int',has_traffic_filtering=True,id=ff1d7189-1721-4f3b-9c25-2aa8f71d9577,network=Network(4a154aa2-0773-459f-b145-b76412506085),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff1d7189-17')
Oct 26 15:58:38 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Deleting instance files /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2_del
Oct 26 15:58:38 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Deletion of /opt/stack/data/nova/instances/5fbfcaaa-f050-473e-9e59-e48179a606e2_del complete
Oct 26 15:58:38 user nova-compute[74646]: INFO nova.compute.manager [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 26 15:58:38 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 15:58:38 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 15:58:38 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 15:58:39 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:58:39 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Took 0.85 seconds to deallocate network for instance.
Oct 26 15:58:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:39 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:58:39 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:58:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:39 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Deleted allocations for instance 5fbfcaaa-f050-473e-9e59-e48179a606e2
Oct 26 15:58:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f45d87b9-00dd-4268-bd81-3edcfa119269 tempest-AttachVolumeTestJSON-1526735619 tempest-AttachVolumeTestJSON-1526735619-project-member] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.437s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-5f7a044f-f952-41c9-a55f-83d1a1298cd7 req-43cdd9c3-26d2-4468-86e6-23cfa3aa7eda service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Received event network-vif-plugged-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:58:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5f7a044f-f952-41c9-a55f-83d1a1298cd7 req-43cdd9c3-26d2-4468-86e6-23cfa3aa7eda service nova] Acquiring lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:58:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5f7a044f-f952-41c9-a55f-83d1a1298cd7 req-43cdd9c3-26d2-4468-86e6-23cfa3aa7eda service nova] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:58:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5f7a044f-f952-41c9-a55f-83d1a1298cd7 req-43cdd9c3-26d2-4468-86e6-23cfa3aa7eda service nova] Lock "5fbfcaaa-f050-473e-9e59-e48179a606e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:58:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-5f7a044f-f952-41c9-a55f-83d1a1298cd7 req-43cdd9c3-26d2-4468-86e6-23cfa3aa7eda service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] No waiting events found dispatching network-vif-plugged-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:58:39 user nova-compute[74646]: WARNING nova.compute.manager [req-5f7a044f-f952-41c9-a55f-83d1a1298cd7 req-43cdd9c3-26d2-4468-86e6-23cfa3aa7eda service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Received unexpected event network-vif-plugged-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 for instance with vm_state deleted and task_state None.
Oct 26 15:58:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-5f7a044f-f952-41c9-a55f-83d1a1298cd7 req-43cdd9c3-26d2-4468-86e6-23cfa3aa7eda service nova] [instance: 5fbfcaaa-f050-473e-9e59-e48179a606e2] Received event network-vif-deleted-ff1d7189-1721-4f3b-9c25-2aa8f71d9577 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:58:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:58:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:12 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:59:12 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Cleaning up deleted instances {{(pid=74646) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 15:59:12 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] There are 0 instances to clean {{(pid=74646) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 15:59:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:59:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:59:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:59:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:59:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Cleaning up deleted instances with incomplete migration  {{(pid=74646) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 15:59:20 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:59:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:20 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 15:59:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 15:59:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:24 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:59:24 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 15:59:24 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7529MB free_disk=25.42218780517578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 15:59:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2b514455-44b2-4115-bb13-38ba1713a263 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 96a71d00-27f0-4dbe-88cb-e6f296178e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 65393333-197f-400e-89b5-7438f5697169 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 51088a91-dc4a-467c-8f35-3c85a9ddd3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance ac760a1e-ead6-4a6f-90d0-0ecd10d7c600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing inventories for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Updating ProviderTree inventory for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Updating inventory in ProviderTree for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing aggregate associations for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6, aggregates: None {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing trait associations for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.762s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:25 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:59:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "65393333-197f-400e-89b5-7438f5697169" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "65393333-197f-400e-89b5-7438f5697169" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:26 user nova-compute[74646]: INFO nova.compute.manager [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Detaching volume b7b752eb-7344-408e-8ae3-8980db762634
Oct 26 15:59:26 user nova-compute[74646]: INFO nova.virt.block_device [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Attempting to driver detach volume b7b752eb-7344-408e-8ae3-8980db762634 from mountpoint /dev/vdb
Oct 26 15:59:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Attempting to detach device vdb from instance 65393333-197f-400e-89b5-7438f5697169 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 15:59:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 15:59:26 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:59:26 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 15:59:26 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:59:26 user nova-compute[74646]:   <serial>b7b752eb-7344-408e-8ae3-8980db762634</serial>
Oct 26 15:59:26 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 15:59:26 user nova-compute[74646]: </disk>
Oct 26 15:59:26 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:59:26 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Successfully detached device vdb from instance 65393333-197f-400e-89b5-7438f5697169 from the persistent domain config.
Oct 26 15:59:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 65393333-197f-400e-89b5-7438f5697169 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 15:59:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 15:59:26 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:59:26 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 15:59:26 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:59:26 user nova-compute[74646]:   <serial>b7b752eb-7344-408e-8ae3-8980db762634</serial>
Oct 26 15:59:26 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 15:59:26 user nova-compute[74646]: </disk>
Oct 26 15:59:26 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 15:59:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "65393333-197f-400e-89b5-7438f5697169" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:26 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:59:26 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 15:59:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-2b514455-44b2-4115-bb13-38ba1713a263" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:59:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-2b514455-44b2-4115-bb13-38ba1713a263" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:59:26 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 15:59:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 65393333-197f-400e-89b5-7438f5697169 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 15:59:27 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Updating instance_info_cache with network_info: [{"id": "db3b9afe-9410-40a7-981e-cb59201a81b2", "address": "fa:16:3e:4a:fd:67", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3b9afe-94", "ovs_interfaceid": "db3b9afe-9410-40a7-981e-cb59201a81b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:59:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-2b514455-44b2-4115-bb13-38ba1713a263" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:59:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 15:59:27 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:59:27 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:59:27 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:59:27 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:59:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 15:59:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:59:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 15:59:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 15:59:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 15:59:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:28 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 15:59:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-19d41929-526e-4c10-9c0f-9c3a439612f4 req-3c0cb645-5d39-495f-ab48-d8947d35c416 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Received event network-changed-a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:59:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-19d41929-526e-4c10-9c0f-9c3a439612f4 req-3c0cb645-5d39-495f-ab48-d8947d35c416 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Refreshing instance network info cache due to event network-changed-a74a819f-2d80-4dca-bf03-eb6bf80868ba. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 15:59:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-19d41929-526e-4c10-9c0f-9c3a439612f4 req-3c0cb645-5d39-495f-ab48-d8947d35c416 service nova] Acquiring lock "refresh_cache-89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:59:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-19d41929-526e-4c10-9c0f-9c3a439612f4 req-3c0cb645-5d39-495f-ab48-d8947d35c416 service nova] Acquired lock "refresh_cache-89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:59:29 user nova-compute[74646]: DEBUG nova.network.neutron [req-19d41929-526e-4c10-9c0f-9c3a439612f4 req-3c0cb645-5d39-495f-ab48-d8947d35c416 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Refreshing network info cache for port a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG nova.network.neutron [req-19d41929-526e-4c10-9c0f-9c3a439612f4 req-3c0cb645-5d39-495f-ab48-d8947d35c416 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Updated VIF entry in instance network info cache for port a74a819f-2d80-4dca-bf03-eb6bf80868ba. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG nova.network.neutron [req-19d41929-526e-4c10-9c0f-9c3a439612f4 req-3c0cb645-5d39-495f-ab48-d8947d35c416 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Updating instance_info_cache with network_info: [{"id": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "address": "fa:16:3e:cc:b0:d3", "network": {"id": "d4f65670-c099-417c-97c5-e3233f89a476", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1710572970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fd26edea684a8d997c1b577ff8d859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a819f-2d", "ovs_interfaceid": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-19d41929-526e-4c10-9c0f-9c3a439612f4 req-3c0cb645-5d39-495f-ab48-d8947d35c416 service nova] Releasing lock "refresh_cache-89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG nova.objects.instance [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lazy-loading 'flavor' on Instance uuid 96a71d00-27f0-4dbe-88cb-e6f296178e90 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:30 user nova-compute[74646]: INFO nova.compute.manager [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Attaching volume f149e265-10cd-4341-9baf-859d99ae7509 to /dev/vdb
Oct 26 15:59:30 user nova-compute[74646]: DEBUG os_brick.utils [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[688851b7-7233-445f-9a21-d8f18753e5f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0c7559-5fcd-4864-a899-5156dae4fd1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed483bc9-51ae-432b-a501-1513fd179179]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7614198f-4cd2-48ea-aede-97444b9eea99]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:59:30 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:59:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e617706-19f3-4277-a9ac-490407359601]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG os_brick.utils [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:59:30 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating existing volume attachment record: 9f5b0bdf-2980-47c0-bfc3-6476cbc4d237 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:59:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:36 user nova-compute[74646]: DEBUG nova.objects.instance [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lazy-loading 'flavor' on Instance uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:59:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.103s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:36 user nova-compute[74646]: INFO nova.compute.manager [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Attaching volume 39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb to /dev/vdb
Oct 26 15:59:37 user nova-compute[74646]: DEBUG os_brick.utils [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae595b07-fd1b-4e68-9b38-d65930d2e6c4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[392bcaa1-7404-4db6-a131-2aaa4a1c2ffb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d565f87d-5218-4ec6-a695-dec3903de7b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9320f645-1f0c-4370-8f15-2944c49b9288]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:59:37 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:59:37 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2582cf1a-1439-4153-8e25-8469024f2010]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG os_brick.utils [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:59:37 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Updating existing volume attachment record: 3ad023b3-1aab-441c-aeb8-c91345e2440e {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:59:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:46 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 65393333-197f-400e-89b5-7438f5697169 is timed out.
Oct 26 15:59:46 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Successfully detached device vdb from instance 65393333-197f-400e-89b5-7438f5697169 from the live domain config.
Oct 26 15:59:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:59:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBQdHkOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:59:46 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:59:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:59:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:59:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9087dab6-9328-47a1-a740-789c88979b90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:59:46 user nova-compute[74646]: No targets found.
Oct 26 15:59:46 user nova-compute[74646]: iSNS:
Oct 26 15:59:46 user nova-compute[74646]: No targets found.
Oct 26 15:59:46 user nova-compute[74646]: STATIC:
Oct 26 15:59:46 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634
Oct 26 15:59:46 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:59:46 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:59:46 user nova-compute[74646]: FIRMWARE:
Oct 26 15:59:46 user nova-compute[74646]: No targets found.
Oct 26 15:59:46 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:59:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:59:46 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:59:46 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:59:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:59:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d936d311-a8d4-4a58-b005-eacd4f339676]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce42c2df-4da4-480f-aecd-0269394b6db1]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 (non-flash)
Oct 26 15:59:47 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 (non-flash)
Oct 26 15:59:47 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e81c8310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634'): ({'sdb'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Removing single pathed devices sdb {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83404f5-06b5-4f61-a7f4-865fdb2bcbc0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ba4d8f-4b88-43c8-a1e1-3b3fd09f7e21]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Flushing IO for device /dev/sdb {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d396f0-2cc5-4a54-8eb9-b8deb4057e1a]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[284b98ae-ccb1-40eb-889b-1dcf5165fcbd]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae529414-ab24-4c91-a7ef-fd9a511ef2e9]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff418d18-a396-4033-8230-2dc7c47ca6fd]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634, portal: 172.16.0.220,3260]
Oct 26 15:59:47 user nova-compute[74646]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634, portal: 172.16.0.220,3260] successful.
Oct 26 15:59:47 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2f7193-4f47-4eed-bce7-f010b76a2b86]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] <== disconnect_volume: return (351ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:59:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:59:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG nova.objects.instance [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lazy-loading 'flavor' on Instance uuid 65393333-197f-400e-89b5-7438f5697169 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5a9315a5-ba45-4213-8031-d2bb844c2700 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "65393333-197f-400e-89b5-7438f5697169" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.005s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "65393333-197f-400e-89b5-7438f5697169" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 25.797s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "65393333-197f-400e-89b5-7438f5697169-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "65393333-197f-400e-89b5-7438f5697169-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "65393333-197f-400e-89b5-7438f5697169-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:52 user nova-compute[74646]: INFO nova.compute.manager [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Terminating instance
Oct 26 15:59:52 user nova-compute[74646]: DEBUG nova.compute.manager [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIAGxZjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:59:52 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:59:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:59:52 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:59:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:59:52 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79d0e7b-28ac-4609-8190-bd7af47b31d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 15:59:52 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed23bb9-03fc-456b-88dc-49de407eac54]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509] added
Oct 26 15:59:52 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc821e6-449c-49f5-b8fe-6f9bf0fbedc3]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:59:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aee2ad0-385c-47a7-995e-780c36db43eb]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIAGxZjY {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIAGxZjY" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf3906a-29bc-4811-883d-935218125148]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIAGxZjY'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG nova.objects.instance [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lazy-loading 'flavor' on Instance uuid 51088a91-dc4a-467c-8f35-3c85a9ddd3c4 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f69d3e-cfc4-4ee7-9356-b9c4c6467e7d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[814659bd-20de-4cd6-886f-d6f3142fa1b7]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 26 15:59:53 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 26 15:59:53 user nova-compute[74646]:  {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:59:53 user nova-compute[74646]: WARNING os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 26 15:59:53 user nova-compute[74646]: 
Oct 26 15:59:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[379bba23-3738-443e-a7c7-14bbec00ad1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260]
Oct 26 15:59:53 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260] successful.
Oct 26 15:59:53 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:53 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 65393333-197f-400e-89b5-7438f5697169] Instance destroyed successfully.
Oct 26 15:59:53 user nova-compute[74646]: DEBUG nova.objects.instance [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lazy-loading 'resources' on Instance uuid 65393333-197f-400e-89b5-7438f5697169 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:56:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1633789750',display_name='tempest-VolumesSnapshotTestJSON-instance-1633789750',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1633789750',id=17,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGjmiEiGjQdnKXfo2EpC1M56jgxLw8Kgvc7t9WhsjCqXY02ufoxy3M2uO494Ai1rHpiLmQ49K1SejHgwqJ0qRBXYd78avDKvphOS95dD+bWYpuvL1Luu1SQV1gbezOjuQg==',key_name='tempest-keypair-1343682025',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:56:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94630fc764f54e5782d3551bfe65e882',ramdisk_id='',reservation_id='r-vvl24ais',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1332594439',owner_user_name='tempest-VolumesSnapshotTestJSON-1332594439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:56:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b57a8707539042deafe65215e10974eb',uuid=65393333-197f-400e-89b5-7438f5697169,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "address": "fa:16:3e:1c:80:7c", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba2fc0f-9e", "ovs_interfaceid": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Converting VIF {"id": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "address": "fa:16:3e:1c:80:7c", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbba2fc0f-9e", "ovs_interfaceid": "bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:80:7c,bridge_name='br-int',has_traffic_filtering=True,id=bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd,network=Network(a8f622c2-5f60-4987-ad67-fe6d77ba5a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba2fc0f-9e') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_vif [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:80:7c,bridge_name='br-int',has_traffic_filtering=True,id=bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd,network=Network(a8f622c2-5f60-4987-ad67-fe6d77ba5a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba2fc0f-9e') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d44d57-19fc-49b4-baf7-4d23bac809e1]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbba2fc0f-9e, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d0abbb0-626d-47fd-8a31-a7482c4bda7b) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:53 user nova-compute[74646]: INFO os_vif [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:80:7c,bridge_name='br-int',has_traffic_filtering=True,id=bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd,network=Network(a8f622c2-5f60-4987-ad67-fe6d77ba5a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbba2fc0f-9e')
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d50e1a-ade4-4bc5-b72e-94765e0619aa]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 15:59:53 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 15:59:53 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.386s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] HCTL ('33', '-', '-', 0) found on session 20 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IBQdHkOr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:59:53 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7361f54e-b784-4edf-b940-1a0cf49bf6b7]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: None {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG nova.compute.manager [req-874e0938-5814-4a04-a715-6dca21fa99a2 req-9be9a482-7f57-4194-8d02-ee492747ad19 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received event network-vif-unplugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-874e0938-5814-4a04-a715-6dca21fa99a2 req-9be9a482-7f57-4194-8d02-ee492747ad19 service nova] Acquiring lock "65393333-197f-400e-89b5-7438f5697169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-874e0938-5814-4a04-a715-6dca21fa99a2 req-9be9a482-7f57-4194-8d02-ee492747ad19 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-874e0938-5814-4a04-a715-6dca21fa99a2 req-9be9a482-7f57-4194-8d02-ee492747ad19 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG nova.compute.manager [req-874e0938-5814-4a04-a715-6dca21fa99a2 req-9be9a482-7f57-4194-8d02-ee492747ad19 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] No waiting events found dispatching network-vif-unplugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG nova.compute.manager [req-874e0938-5814-4a04-a715-6dca21fa99a2 req-9be9a482-7f57-4194-8d02-ee492747ad19 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received event network-vif-unplugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:53 user nova-compute[74646]: INFO nova.compute.manager [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Attaching volume 5e76999b-bb21-43ef-ab3c-f058afa6cb8d to /dev/vdb
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.utils [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[772f558f-5b71-41e9-a793-96179736b1e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[81519923-51f9-4b08-a1b1-dce90257dece]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6961760-36c1-4d5e-a851-d0265a04b189]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc13b14-0e30-4fdc-8a18-239d96382533]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 15:59:53 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 15:59:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3a00c5-6e63-406b-867f-0f5254ea771d]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG os_brick.utils [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:59:53 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Updating existing volume attachment record: 2a5bbd53-5362-495d-9463-f2cdd8062f96 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Searching for a device in session 20 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIAGxZjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] <== connect_volume: return (1437ms) {'type': 'block', 'scsi_wwn': '23866366261613861', 'path': '/dev/sdb'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866366261613861', 'path': '/dev/sdb'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.039s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG nova.objects.instance [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lazy-loading 'flavor' on Instance uuid 96a71d00-27f0-4dbe-88cb-e6f296178e90 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b7dd68-e8b4-4660-a190-9555f9a6a860]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 15:59:54 user nova-compute[74646]: No targets found.
Oct 26 15:59:54 user nova-compute[74646]: iSNS:
Oct 26 15:59:54 user nova-compute[74646]: No targets found.
Oct 26 15:59:54 user nova-compute[74646]: STATIC:
Oct 26 15:59:54 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509
Oct 26 15:59:54 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 15:59:54 user nova-compute[74646]:                 Iface Name: default
Oct 26 15:59:54 user nova-compute[74646]: FIRMWARE:
Oct 26 15:59:54 user nova-compute[74646]: No targets found.
Oct 26 15:59:54 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 15:59:54 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 15:59:54 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b7b752eb-7344-408e-8ae3-8980db762634', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 15:59:54 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 15:59:54 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 15:59:54 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 15:59:54 user nova-compute[74646]:   <serial>f149e265-10cd-4341-9baf-859d99ae7509</serial>
Oct 26 15:59:54 user nova-compute[74646]: </disk>
Oct 26 15:59:54 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[949f2f90-56a9-4e0f-a34b-c7ab70af3ec9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb59a89-94f8-4fdb-8e03-4bcc1b2cb2ca]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 15:59:54 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 15:59:54 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e03b8af0>, {}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Disconnecting from: [] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.094s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] <== disconnect_volume: return (1133ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 15:59:54 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Deleting instance files /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169_del
Oct 26 15:59:54 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Deletion of /opt/stack/data/nova/instances/65393333-197f-400e-89b5-7438f5697169_del complete
Oct 26 15:59:54 user nova-compute[74646]: INFO nova.compute.manager [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Took 2.20 seconds to destroy the instance on the hypervisor.
Oct 26 15:59:54 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 65393333-197f-400e-89b5-7438f5697169] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 65393333-197f-400e-89b5-7438f5697169] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 15:59:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] No VIF found with MAC fa:16:3e:7e:a4:63, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-801347a9-e223-4d25-ba09-7a64b54df321 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.390s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received event network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Acquiring lock "65393333-197f-400e-89b5-7438f5697169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] No waiting events found dispatching network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:59:55 user nova-compute[74646]: WARNING nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received unexpected event network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd for instance with vm_state active and task_state deleting.
Oct 26 15:59:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received event network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Acquiring lock "65393333-197f-400e-89b5-7438f5697169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] No waiting events found dispatching network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:59:55 user nova-compute[74646]: WARNING nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received unexpected event network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd for instance with vm_state active and task_state deleting.
Oct 26 15:59:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received event network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Acquiring lock "65393333-197f-400e-89b5-7438f5697169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] No waiting events found dispatching network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:59:55 user nova-compute[74646]: WARNING nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received unexpected event network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd for instance with vm_state active and task_state deleting.
Oct 26 15:59:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received event network-vif-unplugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Acquiring lock "65393333-197f-400e-89b5-7438f5697169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] No waiting events found dispatching network-vif-unplugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received event network-vif-unplugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received event network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Acquiring lock "65393333-197f-400e-89b5-7438f5697169-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] Lock "65393333-197f-400e-89b5-7438f5697169-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] No waiting events found dispatching network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 15:59:55 user nova-compute[74646]: WARNING nova.compute.manager [req-7940b35d-c7fc-488f-bdb7-3b29f2fce0f6 req-3ec2a963-be17-4302-b15d-50695bb5ee42 service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received unexpected event network-vif-plugged-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd for instance with vm_state active and task_state deleting.
Oct 26 15:59:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 65393333-197f-400e-89b5-7438f5697169] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:59:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-99974f2b-ee7e-4c7d-b99d-cdec1e0f5526 req-4f653cab-f55b-4b27-978b-1c29e16d61bb service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Received event network-vif-deleted-bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 15:59:55 user nova-compute[74646]: INFO nova.compute.manager [req-99974f2b-ee7e-4c7d-b99d-cdec1e0f5526 req-4f653cab-f55b-4b27-978b-1c29e16d61bb service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Neutron deleted interface bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd; detaching it from the instance and deleting it from the info cache
Oct 26 15:59:55 user nova-compute[74646]: DEBUG nova.network.neutron [req-99974f2b-ee7e-4c7d-b99d-cdec1e0f5526 req-4f653cab-f55b-4b27-978b-1c29e16d61bb service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:59:55 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 65393333-197f-400e-89b5-7438f5697169] Took 1.46 seconds to deallocate network for instance.
Oct 26 15:59:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-99974f2b-ee7e-4c7d-b99d-cdec1e0f5526 req-4f653cab-f55b-4b27-978b-1c29e16d61bb service nova] [instance: 65393333-197f-400e-89b5-7438f5697169] Detach interface failed, port_id=bba2fc0f-9e44-4b00-8c4d-c4e2646a7dcd, reason: Instance 65393333-197f-400e-89b5-7438f5697169 could not be found. {{(pid=74646) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 15:59:56 user nova-compute[74646]: WARNING nova.volume.cinder [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Attachment 7fedbdfd-4a07-4f36-a9b0-7945dae8b69e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7fedbdfd-4a07-4f36-a9b0-7945dae8b69e. (HTTP 404) (Request-ID: req-7fb1ccfb-16a4-4999-b89a-81be5aa0f538)
Oct 26 15:59:56 user nova-compute[74646]: INFO nova.compute.manager [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: 65393333-197f-400e-89b5-7438f5697169] Took 0.03 seconds to detach 1 volumes for instance.
Oct 26 15:59:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:56 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:59:56 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:59:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:56 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Deleted allocations for instance 65393333-197f-400e-89b5-7438f5697169
Oct 26 15:59:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bb29acfe-fe97-462d-9eb6-23104536578f tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "65393333-197f-400e-89b5-7438f5697169" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.337s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:58 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Stashing vm_state: active {{(pid=74646) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 26 15:59:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 15:59:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 15:59:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 15:59:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 15:59:58 user nova-compute[74646]: INFO nova.compute.claims [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Claim successful on node user
Oct 26 15:59:58 user nova-compute[74646]: INFO nova.compute.resource_tracker [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating resource usage from migration d8bca77f-f719-4aee-9148-1fcb26e28bc8
Oct 26 15:59:59 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 15:59:59 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 15:59:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.532s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 15:59:59 user nova-compute[74646]: INFO nova.compute.manager [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Migrating
Oct 26 15:59:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:59:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:59:59 user nova-compute[74646]: INFO nova.compute.rpcapi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 26 15:59:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 15:59:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 15:59:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquired lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 15:59:59 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 15:59:59 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating instance_info_cache with network_info: [{"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 15:59:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Releasing lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Starting migrate_disk_and_power_off {{(pid=74646) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISvqhgOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:00:00 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:00:00 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:00:00 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5731301e-d37f-46b9-a020-93f5f79a307b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:00:00 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6446572d-b475-4dcb-803a-f3f2769599ea]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb] added
Oct 26 16:00:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[43420f5d-1d3a-43a1-bd45-d7c2014c9228]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b5f1d7-f158-48f6-863d-badbbbf798d8]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISvqhgOe {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ISvqhgOe" returned: 0 in 0.031s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f08a24-740d-4830-b6d2-534d4bfdc7e7]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ISvqhgOe'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[521a1118-350d-4661-a5d3-50baa05aaccd]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5370b1a4-8799-4f71-9bc6-4d8f7483dfad]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:00:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:00:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --login" returned: 0 in 0.083s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[13adebbf-b50e-4ef0-846f-7f544479badf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb, portal: 172.16.0.220,3260]
Oct 26 16:00:00 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb, portal: 172.16.0.220,3260] successful.
Oct 26 16:00:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4378acec-80a1-4fec-8fee-26cc7fd03245]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eaf9f1e-7223-4162-9abb-758a99f8bc1e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:00:00 user nova-compute[74646]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:00:00 user nova-compute[74646]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.032s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02c0726-d9f8-40bd-884d-6f61f31de038]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISvqhgOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-2db29009-d6ef-4476-a34c-78fe9b43ee4e req-6c7c7a31-db98-4295-9cf8-e106477d9cc9 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received event network-changed-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-2db29009-d6ef-4476-a34c-78fe9b43ee4e req-6c7c7a31-db98-4295-9cf8-e106477d9cc9 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Refreshing instance network info cache due to event network-changed-c3fa2d89-235f-4939-8eff-e59c02c578fe. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2db29009-d6ef-4476-a34c-78fe9b43ee4e req-6c7c7a31-db98-4295-9cf8-e106477d9cc9 service nova] Acquiring lock "refresh_cache-b79f5ea4-ea88-41b4-8ca2-116b5b6408de" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2db29009-d6ef-4476-a34c-78fe9b43ee4e req-6c7c7a31-db98-4295-9cf8-e106477d9cc9 service nova] Acquired lock "refresh_cache-b79f5ea4-ea88-41b4-8ca2-116b5b6408de" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-2db29009-d6ef-4476-a34c-78fe9b43ee4e req-6c7c7a31-db98-4295-9cf8-e106477d9cc9 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Refreshing network info cache for port c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG nova.compute.manager [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:00:00 user nova-compute[74646]: INFO nova.compute.manager [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] instance snapshotting
Oct 26 16:00:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:00 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Instance destroyed successfully.
Oct 26 16:00:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-577894992',display_name='tempest-ServerActionsTestOtherB-server-577894992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-577894992',id=16,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8WuJBWWQ3dPKpsfd3pTt9BdyjBEif+cyL8w8Tg3VzJlkHtDxzbffk6KqqzEPT5s/X3OVnkganTQcqlWVpiRN+miRvt4exLQM5oDzUYlmj5/y40opmavHEPxTdEvfSLNw==',key_name='tempest-keypair-721457332',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5c99559f6003420bb1014bdb0f0988ff',ramdisk_id='',reservation_id='r-4yydauu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1825400277',owner_user_name='tempest-ServerActionsTestOtherB-1825400277-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T15:59:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86031b2e164644e0a59efcd110ddf497',uuid=96a71d00-27f0-4dbe-88cb-e6f296178e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1494730225-network", "vif_mac": "fa:16:3e:7e:a4:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converting VIF {"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1494730225-network", "vif_mac": "fa:16:3e:7e:a4:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_vif [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e16bb7b-c1, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0abdfd69-0df1-480d-9837-e2c41ccca168) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:00:00 user nova-compute[74646]: INFO os_vif [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1')
Oct 26 16:00:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIAGxZjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:00:00 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:00:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:00:00 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Beginning live snapshot process
Oct 26 16:00:01 user nova-compute[74646]: DEBUG nova.network.neutron [req-2db29009-d6ef-4476-a34c-78fe9b43ee4e req-6c7c7a31-db98-4295-9cf8-e106477d9cc9 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Updated VIF entry in instance network info cache for port c3fa2d89-235f-4939-8eff-e59c02c578fe. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG nova.network.neutron [req-2db29009-d6ef-4476-a34c-78fe9b43ee4e req-6c7c7a31-db98-4295-9cf8-e106477d9cc9 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Updating instance_info_cache with network_info: [{"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2db29009-d6ef-4476-a34c-78fe9b43ee4e req-6c7c7a31-db98-4295-9cf8-e106477d9cc9 service nova] Releasing lock "refresh_cache-b79f5ea4-ea88-41b4-8ca2-116b5b6408de" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.407s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] <== connect_volume: return (1410ms) {'type': 'block', 'scsi_wwn': '23835663264363338', 'path': '/dev/sdc'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835663264363338', 'path': '/dev/sdc'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.475s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json -f qcow2 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea41a42-396c-4e51-aaa4-c8fcbde020c1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:00:01 user nova-compute[74646]: No targets found.
Oct 26 16:00:01 user nova-compute[74646]: iSNS:
Oct 26 16:00:01 user nova-compute[74646]: No targets found.
Oct 26 16:00:01 user nova-compute[74646]: STATIC:
Oct 26 16:00:01 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb
Oct 26 16:00:01 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:00:01 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:00:01 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509
Oct 26 16:00:01 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:00:01 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:00:01 user nova-compute[74646]: FIRMWARE:
Oct 26 16:00:01 user nova-compute[74646]: No targets found.
Oct 26 16:00:01 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:00:01 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:00:01 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG nova.objects.instance [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lazy-loading 'flavor' on Instance uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aeccd2c-5e96-42a5-819e-2002d16b9943]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG nova.objects.instance [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lazy-loading 'flavor' on Instance uuid b79f5ea4-ea88-41b4-8ca2-116b5b6408de {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:00:01 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:00:01 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 16:00:01 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:00:01 user nova-compute[74646]:   <serial>39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb</serial>
Oct 26 16:00:01 user nova-compute[74646]: </disk>
Oct 26 16:00:01 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[830949b0-f304-40a5-9a64-ab80c0521e2e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:00:01 user nova-compute[74646]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:01 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:00:01 user nova-compute[74646]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:01 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e8270e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509'): ({'sdb'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Removing single pathed devices sdb {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[493afe1e-5591-4d7e-be23-342fa69a7715]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef8dba9f-d379-466d-bb67-49076e035d6e]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Flushing IO for device /dev/sdb {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea3af93-9fcf-4b23-ba6c-7004b066e9ef]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json -f qcow2" returned: 0 in 0.235s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json -f qcow2 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b0f02d6-c04c-4571-8e7b-22387190dce5]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[64626bf4-6096-4320-9925-d925f7edca24]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2505c9-c1ea-4158-a665-a7870a714dd0]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260]
Oct 26 16:00:01 user nova-compute[74646]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260] successful.
Oct 26 16:00:01 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:01 user nova-compute[74646]: INFO nova.compute.manager [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Attaching volume f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a to /dev/vdb
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[893c61dc-85ac-4c1f-a5a3-c76343724aa8]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.451s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] <== disconnect_volume: return (926ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json -f qcow2" returned: 0 in 0.290s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG os_brick.utils [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] No VIF found with MAC fa:16:3e:cc:b0:d3, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f54137-ae63-49f7-b0a4-786e0e30e178]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c892c212-550d-4f6c-a40f-020b0da6b2b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c33fd06-6902-4dea-8603-b2efcbb19b0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b71829-062e-4bbd-89dd-dbc7d36c2558]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.240s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps8g0m12n/d7e014bbf3f64a52be9e5fab00834380.delta 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:00:02 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab72adc4-8bc0-4bc8-87ff-c8b348cfc7ef]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG os_brick.utils [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] <== get_connector_properties: return (258ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Updating existing volume attachment record: 9a6b4d35-1f86-4d1a-bd95-19c82194ccc1 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmps8g0m12n/d7e014bbf3f64a52be9e5fab00834380.delta 1073741824" returned: 0 in 0.076s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:02 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-784ffa21-7e2e-4a06-90dc-bf6f9e64a54e tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.367s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:00:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90_resize/disk /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CMD "cp -r /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90_resize/disk /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk" returned: 0 in 0.562s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90_resize/disk.info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk.info {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CMD "cp -r /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90_resize/disk.info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk.info" returned: 0 in 0.034s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] COPY block job progress, current cursor: 786432 final cursor: 75497472 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:00:03 user nova-compute[74646]: INFO nova.compute.claims [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Claim successful on node user
Oct 26 16:00:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 16:00:03 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 16:00:03 user nova-compute[74646]: DEBUG nova.compute.manager [req-938934d3-7bf0-4319-9416-aed57a2de13b req-d0c01a7f-a96e-4469-90f4-f46072c2171c service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-vif-unplugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-938934d3-7bf0-4319-9416-aed57a2de13b req-d0c01a7f-a96e-4469-90f4-f46072c2171c service nova] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-938934d3-7bf0-4319-9416-aed57a2de13b req-d0c01a7f-a96e-4469-90f4-f46072c2171c service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-938934d3-7bf0-4319-9416-aed57a2de13b req-d0c01a7f-a96e-4469-90f4-f46072c2171c service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG nova.compute.manager [req-938934d3-7bf0-4319-9416-aed57a2de13b req-d0c01a7f-a96e-4469-90f4-f46072c2171c service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] No waiting events found dispatching network-vif-unplugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:00:03 user nova-compute[74646]: WARNING nova.compute.manager [req-938934d3-7bf0-4319-9416-aed57a2de13b req-d0c01a7f-a96e-4469-90f4-f46072c2171c service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received unexpected event network-vif-unplugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b for instance with vm_state active and task_state resize_migrating.
Oct 26 16:00:03 user nova-compute[74646]: DEBUG nova.privsep.utils [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74646) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 16:00:03 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps8g0m12n/d7e014bbf3f64a52be9e5fab00834380.delta /opt/stack/data/nova/instances/snapshots/tmps8g0m12n/d7e014bbf3f64a52be9e5fab00834380 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.600s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:00:04 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:00:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG nova.policy [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '36b0bfd61fb8451c8fea1b68075e2581', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '72016ef51af8410c88eb0deb826ae3ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Port 3e16bb7b-c1c2-4a11-aad9-2da2fbae632b binding to destination host user is already ACTIVE {{(pid=74646) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:00:04 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Creating image(s)
Oct 26 16:00:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "/opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "/opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.076s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmps8g0m12n/d7e014bbf3f64a52be9e5fab00834380.delta /opt/stack/data/nova/instances/snapshots/tmps8g0m12n/d7e014bbf3f64a52be9e5fab00834380" returned: 0 in 0.714s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.volume.cinder [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Update attachment failed for attachment 2a5bbd53-5362-495d-9463-f2cdd8062f96. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-865a8ec6-e8d4-4ba3-90f0-9842c89380a0) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-865a8ec6-e8d4-4ba3-90f0-9842c89380a0)
Oct 26 16:00:04 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Snapshot extracted, beginning image upload
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Failed to attach 5e76999b-bb21-43ef-ab3c-f058afa6cb8d at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-865a8ec6-e8d4-4ba3-90f0-9842c89380a0)
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Traceback (most recent call last):
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     ret_val = method(obj, context, *args, **kwargs)
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     self._do_attach(context, instance, volume, volume_api,
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     self._volume_attach(context, volume, connector, instance,
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     connection_info = volume_api.attachment_update(
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     res = method(self, ctx, *args, **kwargs)
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     with excutils.save_and_reraise_exception():
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     self.force_reraise()
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     raise self.value
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     return method.func(obj, *args, **kwargs)
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     resp = self._update('/attachments/%s' % id, body)
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     return self.request(url, method, **kwargs)
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4]     raise exceptions.from_response(resp, body)
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-865a8ec6-e8d4-4ba3-90f0-9842c89380a0)
Oct 26 16:00:04 user nova-compute[74646]: ERROR nova.compute.manager [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] 
Oct 26 16:00:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.262s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.634s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquired lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.207s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk 1073741824" returned: 0 in 0.067s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server [None req-68482f31-df2f-46f0-8057-736fbff550d6 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-865a8ec6-e8d4-4ba3-90f0-9842c89380a0)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-865a8ec6-e8d4-4ba3-90f0-9842c89380a0)
Oct 26 16:00:05 user nova-compute[74646]: ERROR oslo_messaging.rpc.server 
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.193s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Successfully created port: 645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Cannot resize image /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Ensure instance console log exists: /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating instance_info_cache with network_info: [{"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Releasing lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG os_brick.utils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0f1feb-e8f5-4a6b-9275-d5758893f6b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcf900b-af4a-4c67-8b1a-bdce118e73bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-cb9a6cf5-d380-4b61-a018-634612b46c69 req-ab3ed172-d363-40c8-af3b-87204eee0032 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cb9a6cf5-d380-4b61-a018-634612b46c69 req-ab3ed172-d363-40c8-af3b-87204eee0032 service nova] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cb9a6cf5-d380-4b61-a018-634612b46c69 req-ab3ed172-d363-40c8-af3b-87204eee0032 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cb9a6cf5-d380-4b61-a018-634612b46c69 req-ab3ed172-d363-40c8-af3b-87204eee0032 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-cb9a6cf5-d380-4b61-a018-634612b46c69 req-ab3ed172-d363-40c8-af3b-87204eee0032 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] No waiting events found dispatching network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:00:05 user nova-compute[74646]: WARNING nova.compute.manager [req-cb9a6cf5-d380-4b61-a018-634612b46c69 req-ab3ed172-d363-40c8-af3b-87204eee0032 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received unexpected event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b for instance with vm_state active and task_state resize_finish.
Oct 26 16:00:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac919865-f1a0-4ae3-8f0f-114adef7cba7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f554ffc-4409-4c2c-b127-d8cfe5a7e870]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:00:06 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:00:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0f7972-08d0-4334-8728-60bdc8071445]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG os_brick.utils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] <== get_connector_properties: return (168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Successfully updated port: 645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "refresh_cache-2bae2991-6c17-4d79-9dd8-1fc69322f830" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquired lock "refresh_cache-2bae2991-6c17-4d79-9dd8-1fc69322f830" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Updating instance_info_cache with network_info: [{"id": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "address": "fa:16:3e:6e:7d:58", "network": {"id": "af5d1879-5cbd-45d2-97c0-e6cc4ac39d01", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-49924591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72016ef51af8410c88eb0deb826ae3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645c2ddb-c3", "ovs_interfaceid": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Releasing lock "refresh_cache-2bae2991-6c17-4d79-9dd8-1fc69322f830" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Instance network_info: |[{"id": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "address": "fa:16:3e:6e:7d:58", "network": {"id": "af5d1879-5cbd-45d2-97c0-e6cc4ac39d01", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-49924591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72016ef51af8410c88eb0deb826ae3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645c2ddb-c3", "ovs_interfaceid": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Start _get_guest_xml network_info=[{"id": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "address": "fa:16:3e:6e:7d:58", "network": {"id": "af5d1879-5cbd-45d2-97c0-e6cc4ac39d01", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-49924591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72016ef51af8410c88eb0deb826ae3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645c2ddb-c3", "ovs_interfaceid": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:00:06 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:00:06 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:00:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-253863828',display_name='tempest-TestServerVolumeAttachmentScenario-server-253863828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-253863828',id=23,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjzskPLQo5nmWblINqcUhjBMPjk+v3fpkscYh6/tbCluMzdBjp385ici2hsILTrMk+gi1yJjPsTXSQhk1KNalBXCenVtJbHQ4GZH9kdnM/cgvlgLmn/8/JOrQ9TaFP1KQ==',key_name='tempest-keypair-1740650127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72016ef51af8410c88eb0deb826ae3ff',ramdisk_id='',reservation_id='r-cz0ne7jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-352649452',owner_user_name='tempest-TestServerVolumeAttachmentScenario-352649452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36b0bfd61fb8451c8fea1b68075e2581',uuid=2bae2991-6c17-4d79-9dd8-1fc69322f830,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "address": "fa:16:3e:6e:7d:58", "network": {"id": "af5d1879-5cbd-45d2-97c0-e6cc4ac39d01", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-49924591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72016ef51af8410c88eb0deb826ae3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645c2ddb-c3", "ovs_interfaceid": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Converting VIF {"id": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "address": "fa:16:3e:6e:7d:58", "network": {"id": "af5d1879-5cbd-45d2-97c0-e6cc4ac39d01", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-49924591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72016ef51af8410c88eb0deb826ae3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645c2ddb-c3", "ovs_interfaceid": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7d:58,bridge_name='br-int',has_traffic_filtering=True,id=645c2ddb-c31c-454f-8f2f-615bec1fef32,network=Network(af5d1879-5cbd-45d2-97c0-e6cc4ac39d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap645c2ddb-c3') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.objects.instance [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bae2991-6c17-4d79-9dd8-1fc69322f830 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:00:06 user nova-compute[74646]:   <uuid>2bae2991-6c17-4d79-9dd8-1fc69322f830</uuid>
Oct 26 16:00:06 user nova-compute[74646]:   <name>instance-00000017</name>
Oct 26 16:00:06 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:00:06 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:00:06 user nova-compute[74646]:   <metadata>
Oct 26 16:00:06 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:00:06 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:00:06 user nova-compute[74646]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-253863828</nova:name>
Oct 26 16:00:06 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:00:06</nova:creationTime>
Oct 26 16:00:06 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:00:06 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:00:06 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:00:06 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:00:06 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:00:06 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:00:06 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:00:06 user nova-compute[74646]:       <nova:owner>
Oct 26 16:00:06 user nova-compute[74646]:         <nova:user uuid="36b0bfd61fb8451c8fea1b68075e2581">tempest-TestServerVolumeAttachmentScenario-352649452-project-member</nova:user>
Oct 26 16:00:06 user nova-compute[74646]:         <nova:project uuid="72016ef51af8410c88eb0deb826ae3ff">tempest-TestServerVolumeAttachmentScenario-352649452</nova:project>
Oct 26 16:00:06 user nova-compute[74646]:       </nova:owner>
Oct 26 16:00:06 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:00:06 user nova-compute[74646]:       <nova:ports>
Oct 26 16:00:06 user nova-compute[74646]:         <nova:port uuid="645c2ddb-c31c-454f-8f2f-615bec1fef32">
Oct 26 16:00:06 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 16:00:06 user nova-compute[74646]:         </nova:port>
Oct 26 16:00:06 user nova-compute[74646]:       </nova:ports>
Oct 26 16:00:06 user nova-compute[74646]:     </nova:instance>
Oct 26 16:00:06 user nova-compute[74646]:   </metadata>
Oct 26 16:00:06 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:00:06 user nova-compute[74646]:     <system>
Oct 26 16:00:06 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:00:06 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:00:06 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:00:06 user nova-compute[74646]:       <entry name="serial">2bae2991-6c17-4d79-9dd8-1fc69322f830</entry>
Oct 26 16:00:06 user nova-compute[74646]:       <entry name="uuid">2bae2991-6c17-4d79-9dd8-1fc69322f830</entry>
Oct 26 16:00:06 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:00:06 user nova-compute[74646]:     </system>
Oct 26 16:00:06 user nova-compute[74646]:   </sysinfo>
Oct 26 16:00:06 user nova-compute[74646]:   <os>
Oct 26 16:00:06 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:00:06 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:00:06 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:00:06 user nova-compute[74646]:   </os>
Oct 26 16:00:06 user nova-compute[74646]:   <features>
Oct 26 16:00:06 user nova-compute[74646]:     <acpi/>
Oct 26 16:00:06 user nova-compute[74646]:     <apic/>
Oct 26 16:00:06 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:00:06 user nova-compute[74646]:   </features>
Oct 26 16:00:06 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:00:06 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:00:06 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:00:06 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:00:06 user nova-compute[74646]:   </clock>
Oct 26 16:00:06 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:00:06 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:00:06 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:00:06 user nova-compute[74646]:   </cpu>
Oct 26 16:00:06 user nova-compute[74646]:   <devices>
Oct 26 16:00:06 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:00:06 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:00:06 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk"/>
Oct 26 16:00:06 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:00:06 user nova-compute[74646]:     </disk>
Oct 26 16:00:06 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:00:06 user nova-compute[74646]:       <mac address="fa:16:3e:6e:7d:58"/>
Oct 26 16:00:06 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:00:06 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:00:06 user nova-compute[74646]:       <target dev="tap645c2ddb-c3"/>
Oct 26 16:00:06 user nova-compute[74646]:     </interface>
Oct 26 16:00:06 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:00:06 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/console.log" append="off"/>
Oct 26 16:00:06 user nova-compute[74646]:     </serial>
Oct 26 16:00:06 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:00:06 user nova-compute[74646]:     <video>
Oct 26 16:00:06 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:00:06 user nova-compute[74646]:     </video>
Oct 26 16:00:06 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:00:06 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:00:06 user nova-compute[74646]:     </rng>
Oct 26 16:00:06 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:00:06 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:00:06 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:00:06 user nova-compute[74646]:     </memballoon>
Oct 26 16:00:06 user nova-compute[74646]:   </devices>
Oct 26 16:00:06 user nova-compute[74646]: </domain>
Oct 26 16:00:06 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:00:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-253863828',display_name='tempest-TestServerVolumeAttachmentScenario-server-253863828',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-253863828',id=23,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjzskPLQo5nmWblINqcUhjBMPjk+v3fpkscYh6/tbCluMzdBjp385ici2hsILTrMk+gi1yJjPsTXSQhk1KNalBXCenVtJbHQ4GZH9kdnM/cgvlgLmn/8/JOrQ9TaFP1KQ==',key_name='tempest-keypair-1740650127',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='72016ef51af8410c88eb0deb826ae3ff',ramdisk_id='',reservation_id='r-cz0ne7jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-352649452',owner_user_name='tempest-TestServerVolumeAttachmentScenario-352649452-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:00:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36b0bfd61fb8451c8fea1b68075e2581',uuid=2bae2991-6c17-4d79-9dd8-1fc69322f830,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "address": "fa:16:3e:6e:7d:58", "network": {"id": "af5d1879-5cbd-45d2-97c0-e6cc4ac39d01", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-49924591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72016ef51af8410c88eb0deb826ae3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645c2ddb-c3", "ovs_interfaceid": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Converting VIF {"id": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "address": "fa:16:3e:6e:7d:58", "network": {"id": "af5d1879-5cbd-45d2-97c0-e6cc4ac39d01", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-49924591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72016ef51af8410c88eb0deb826ae3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645c2ddb-c3", "ovs_interfaceid": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7d:58,bridge_name='br-int',has_traffic_filtering=True,id=645c2ddb-c31c-454f-8f2f-615bec1fef32,network=Network(af5d1879-5cbd-45d2-97c0-e6cc4ac39d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap645c2ddb-c3') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG os_vif [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7d:58,bridge_name='br-int',has_traffic_filtering=True,id=645c2ddb-c31c-454f-8f2f-615bec1fef32,network=Network(af5d1879-5cbd-45d2-97c0-e6cc4ac39d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap645c2ddb-c3') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '63081902-c20b-570b-8f1a-d8bddf3e1ec8', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap645c2ddb-c3, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap645c2ddb-c3, col_values=(('qos', UUID('c5d35e1a-699a-49e7-88cf-1cad7210beef')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap645c2ddb-c3, col_values=(('external_ids', {'iface-id': '645c2ddb-c31c-454f-8f2f-615bec1fef32', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:7d:58', 'vm-uuid': '2bae2991-6c17-4d79-9dd8-1fc69322f830'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:06 user nova-compute[74646]: INFO os_vif [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:7d:58,bridge_name='br-int',has_traffic_filtering=True,id=645c2ddb-c31c-454f-8f2f-615bec1fef32,network=Network(af5d1879-5cbd-45d2-97c0-e6cc4ac39d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap645c2ddb-c3')
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:00:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] No VIF found with MAC fa:16:3e:6e:7d:58, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:00:07 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Snapshot image upload complete
Oct 26 16:00:07 user nova-compute[74646]: INFO nova.compute.manager [None req-816085ad-97cd-48ca-bb12-3675b332cce3 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Took 6.99 seconds to snapshot the instance on the hypervisor.
Oct 26 16:00:07 user nova-compute[74646]: DEBUG nova.compute.manager [req-a90db617-aa47-44bb-84c1-5f892d9dbc1f req-04b4bdf1-1b56-4b6e-ba48-6aaf83330236 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received event network-changed-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:00:07 user nova-compute[74646]: DEBUG nova.compute.manager [req-a90db617-aa47-44bb-84c1-5f892d9dbc1f req-04b4bdf1-1b56-4b6e-ba48-6aaf83330236 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Refreshing instance network info cache due to event network-changed-645c2ddb-c31c-454f-8f2f-615bec1fef32. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:00:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a90db617-aa47-44bb-84c1-5f892d9dbc1f req-04b4bdf1-1b56-4b6e-ba48-6aaf83330236 service nova] Acquiring lock "refresh_cache-2bae2991-6c17-4d79-9dd8-1fc69322f830" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:00:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a90db617-aa47-44bb-84c1-5f892d9dbc1f req-04b4bdf1-1b56-4b6e-ba48-6aaf83330236 service nova] Acquired lock "refresh_cache-2bae2991-6c17-4d79-9dd8-1fc69322f830" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:00:07 user nova-compute[74646]: DEBUG nova.network.neutron [req-a90db617-aa47-44bb-84c1-5f892d9dbc1f req-04b4bdf1-1b56-4b6e-ba48-6aaf83330236 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Refreshing network info cache for port 645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:00:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:08 user nova-compute[74646]: DEBUG nova.network.neutron [req-a90db617-aa47-44bb-84c1-5f892d9dbc1f req-04b4bdf1-1b56-4b6e-ba48-6aaf83330236 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Updated VIF entry in instance network info cache for port 645c2ddb-c31c-454f-8f2f-615bec1fef32. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:00:08 user nova-compute[74646]: DEBUG nova.network.neutron [req-a90db617-aa47-44bb-84c1-5f892d9dbc1f req-04b4bdf1-1b56-4b6e-ba48-6aaf83330236 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Updating instance_info_cache with network_info: [{"id": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "address": "fa:16:3e:6e:7d:58", "network": {"id": "af5d1879-5cbd-45d2-97c0-e6cc4ac39d01", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-49924591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72016ef51af8410c88eb0deb826ae3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645c2ddb-c3", "ovs_interfaceid": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:00:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a90db617-aa47-44bb-84c1-5f892d9dbc1f req-04b4bdf1-1b56-4b6e-ba48-6aaf83330236 service nova] Releasing lock "refresh_cache-2bae2991-6c17-4d79-9dd8-1fc69322f830" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:00:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-a790ffa4-7e6b-4ed2-a194-ba7b6ae079a8 req-00224cf7-4aa1-453f-a35a-7ec058ff67d7 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received event network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:00:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a790ffa4-7e6b-4ed2-a194-ba7b6ae079a8 req-00224cf7-4aa1-453f-a35a-7ec058ff67d7 service nova] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a790ffa4-7e6b-4ed2-a194-ba7b6ae079a8 req-00224cf7-4aa1-453f-a35a-7ec058ff67d7 service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a790ffa4-7e6b-4ed2-a194-ba7b6ae079a8 req-00224cf7-4aa1-453f-a35a-7ec058ff67d7 service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-a790ffa4-7e6b-4ed2-a194-ba7b6ae079a8 req-00224cf7-4aa1-453f-a35a-7ec058ff67d7 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] No waiting events found dispatching network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:00:08 user nova-compute[74646]: WARNING nova.compute.manager [req-a790ffa4-7e6b-4ed2-a194-ba7b6ae079a8 req-00224cf7-4aa1-453f-a35a-7ec058ff67d7 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received unexpected event network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 for instance with vm_state building and task_state spawning.
Oct 26 16:00:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-73db7fde-65dd-4c58-b776-853dcce38171 req-1a770f3d-ad50-47d8-8bd3-bcded56d11ed service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received event network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:00:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-73db7fde-65dd-4c58-b776-853dcce38171 req-1a770f3d-ad50-47d8-8bd3-bcded56d11ed service nova] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-73db7fde-65dd-4c58-b776-853dcce38171 req-1a770f3d-ad50-47d8-8bd3-bcded56d11ed service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-73db7fde-65dd-4c58-b776-853dcce38171 req-1a770f3d-ad50-47d8-8bd3-bcded56d11ed service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-73db7fde-65dd-4c58-b776-853dcce38171 req-1a770f3d-ad50-47d8-8bd3-bcded56d11ed service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] No waiting events found dispatching network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:00:10 user nova-compute[74646]: WARNING nova.compute.manager [req-73db7fde-65dd-4c58-b776-853dcce38171 req-1a770f3d-ad50-47d8-8bd3-bcded56d11ed service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received unexpected event network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 for instance with vm_state building and task_state spawning.
Oct 26 16:00:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:00:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:00:10 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Instance spawned successfully.
Oct 26 16:00:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:00:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:00:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:00:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:00:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:00:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:00:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:00:10 user nova-compute[74646]: INFO nova.compute.manager [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Took 6.40 seconds to spawn the instance on the hypervisor.
Oct 26 16:00:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:00:11 user nova-compute[74646]: INFO nova.compute.manager [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Took 7.51 seconds to build instance.
Oct 26 16:00:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0e2ff984-5800-4242-8591-8d12a2d28ba9 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.751s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:19 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:00:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:21 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:00:21 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:00:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:00:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:00:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:00:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:00:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:00:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:00:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:00:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTufjnmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:00:24 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:00:24 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:00:24 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc2c9cb-4e85-47b0-a08c-7eca6c8b980d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:00:24 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e45b5b2-81f7-4843-ab16-6e838c681c20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a] added
Oct 26 16:00:24 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff24308-6233-436b-b363-318471044531]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[50524f9c-88a5-4651-9e6f-d1436e9d1f36]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTufjnmw {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTufjnmw" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c039c30d-8dd5-41d9-a24a-250841b8e1bf]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lTufjnmw'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f0cde4-a922-4e7d-b32d-69811f83c47b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7be83d-3379-474d-981a-91b30dc58f52]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:24 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:24 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3726c4b3-9340-42be-bfed-7b19349e1cc6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260]
Oct 26 16:00:24 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260] successful.
Oct 26 16:00:24 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96da325-0ba9-448a-9bc0-6d7e9e56b841]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[506fe098-b2e7-4bec-bce2-8e53ef79f937]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:24 user nova-compute[74646]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:00:24 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:24 user nova-compute[74646]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:00:24 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.038s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9e7781-c544-4a43-acc0-1467628e177d]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTufjnmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.449s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '23630363363623232', 'path': '/dev/sdb'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630363363623232', 'path': '/dev/sdb'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG nova.objects.instance [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lazy-loading 'flavor' on Instance uuid b79f5ea4-ea88-41b4-8ca2-116b5b6408de {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:00:25 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:00:25 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 16:00:25 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:00:25 user nova-compute[74646]:   <serial>f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a</serial>
Oct 26 16:00:25 user nova-compute[74646]: </disk>
Oct 26 16:00:25 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:00:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:00:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:00:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] No VIF found with MAC fa:16:3e:60:7f:15, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:00:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-17ca5ba5-4326-4721-90e6-468a630388e8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.882s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:00:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:27 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:00:27 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:00:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7728MB free_disk=25.35683822631836GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:00:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Applying migration context for instance 96a71d00-27f0-4dbe-88cb-e6f296178e90 as it has an incoming, in-progress migration d8bca77f-f719-4aee-9148-1fcb26e28bc8. Migration status is post-migrating {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 16:00:27 user nova-compute[74646]: INFO nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating resource usage from migration d8bca77f-f719-4aee-9148-1fcb26e28bc8
Oct 26 16:00:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:00:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2b514455-44b2-4115-bb13-38ba1713a263 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:00:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:00:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 51088a91-dc4a-467c-8f35-3c85a9ddd3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:00:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:00:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:00:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance ac760a1e-ead6-4a6f-90d0-0ecd10d7c600 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:00:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Migration d8bca77f-f719-4aee-9148-1fcb26e28bc8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 16:00:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 96a71d00-27f0-4dbe-88cb-e6f296178e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:00:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:00:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:00:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:00:28 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:00:28 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:00:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:00:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.664s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:28 user nova-compute[74646]: INFO nova.compute.manager [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Rebuilding instance
Oct 26 16:00:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-1f99df24-e114-4f36-be16-0aa798559ddf req-7c4c94b7-746e-4914-9eec-4848abd2e79b service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received event network-vif-unplugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f99df24-e114-4f36-be16-0aa798559ddf req-7c4c94b7-746e-4914-9eec-4848abd2e79b service nova] Acquiring lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f99df24-e114-4f36-be16-0aa798559ddf req-7c4c94b7-746e-4914-9eec-4848abd2e79b service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1f99df24-e114-4f36-be16-0aa798559ddf req-7c4c94b7-746e-4914-9eec-4848abd2e79b service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-1f99df24-e114-4f36-be16-0aa798559ddf req-7c4c94b7-746e-4914-9eec-4848abd2e79b service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] No waiting events found dispatching network-vif-unplugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:00:29 user nova-compute[74646]: WARNING nova.compute.manager [req-1f99df24-e114-4f36-be16-0aa798559ddf req-7c4c94b7-746e-4914-9eec-4848abd2e79b service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received unexpected event network-vif-unplugged-c3fa2d89-235f-4939-8eff-e59c02c578fe for instance with vm_state active and task_state rebuilding.
Oct 26 16:00:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Starting finish_migration {{(pid=74646) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Instance directory exists: not creating {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 16:00:29 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Creating image(s)
Oct 26 16:00:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.232s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Checking if we can resize image /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk. size=21474836480 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk 21474836480 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk 21474836480" returned: 0 in 0.058s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Ensure instance console log exists: /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Start _get_guest_xml network_info=[{"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1494730225-network", "vif_mac": "fa:16:3e:7e:a4:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '8a234ff5-4926-45dc-85b3-d31fa127b958', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIAGxZjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '96a71d00-27f0-4dbe-88cb-e6f296178e90', 'attached_at': '2023-10-26T16:00:29.000000', 'detached_at': '', 'volume_id': 'f149e265-10cd-4341-9baf-859d99ae7509', 'serial': 'f149e265-10cd-4341-9baf-859d99ae7509'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:00:30 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Instance destroyed successfully.
Oct 26 16:00:30 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:00:30 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIAGxZjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:00:30 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:00:30 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:00:30 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[39673471-0a2e-4a6a-8114-331a97201bc8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:00:30 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0d3698-8eb8-4ebc-81e0-99829a67ede9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509] added
Oct 26 16:00:30 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cc41f7-7b95-4ad4-b4cc-df45b4817282]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:30 user nova-compute[74646]: INFO nova.compute.manager [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Detaching volume f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb834da9-9a02-4273-9055-48ec39ef2ada]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIAGxZjY {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIAGxZjY" returned: 0 in 0.030s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[998ce4e8-2056-4438-bb41-4954f59e8dba]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIAGxZjY'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:30 user nova-compute[74646]: INFO nova.virt.block_device [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Attempting to driver detach volume f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a from mountpoint /dev/vdb
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[558a89bb-4e1b-4e19-adb5-7c0d3fddce7c]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Attempting to detach device vdb from instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:00:30 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:00:30 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 16:00:30 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:00:30 user nova-compute[74646]:   <serial>f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a</serial>
Oct 26 16:00:30 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:00:30 user nova-compute[74646]: </disk>
Oct 26 16:00:30 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:00:30 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Successfully detached device vdb from instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de from the persistent domain config.
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caf8487-680f-45a4-9b0a-da2deb0a5a62]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:30 user nova-compute[74646]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:00:30 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:30 user nova-compute[74646]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:00:30 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTufjnmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:00:30 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c535ac-a74c-4512-864f-f1fb2191e113]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260]
Oct 26 16:00:30 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260] successful.
Oct 26 16:00:30 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[178f587a-edc6-419f-962f-56cb5b24e45d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[841a585f-0fba-4b37-948f-aa289ac124fd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:30 user nova-compute[74646]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:00:30 user nova-compute[74646]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:00:30 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:30 user nova-compute[74646]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:00:30 user nova-compute[74646]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:00:30 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] HCTL ('35', '-', '-', 0) found on session 23 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e600dd-82ef-4e32-8f02-6555cc6bf077]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: None {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating instance_info_cache with network_info: [{"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:00:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Searching for a device in session 23 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIAGxZjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '23866366261613861', 'path': '/dev/sdd'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866366261613861', 'path': '/dev/sdd'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.156s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG nova.compute.manager [req-b06f2cae-4ff8-45bd-8bf0-0d6ea2e7a04f req-b2231412-037e-41ec-9d2b-66a43e6d1054 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received event network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b06f2cae-4ff8-45bd-8bf0-0d6ea2e7a04f req-b2231412-037e-41ec-9d2b-66a43e6d1054 service nova] Acquiring lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b06f2cae-4ff8-45bd-8bf0-0d6ea2e7a04f req-b2231412-037e-41ec-9d2b-66a43e6d1054 service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b06f2cae-4ff8-45bd-8bf0-0d6ea2e7a04f req-b2231412-037e-41ec-9d2b-66a43e6d1054 service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG nova.compute.manager [req-b06f2cae-4ff8-45bd-8bf0-0d6ea2e7a04f req-b2231412-037e-41ec-9d2b-66a43e6d1054 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] No waiting events found dispatching network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:00:31 user nova-compute[74646]: WARNING nova.compute.manager [req-b06f2cae-4ff8-45bd-8bf0-0d6ea2e7a04f req-b2231412-037e-41ec-9d2b-66a43e6d1054 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received unexpected event network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe for instance with vm_state active and task_state rebuilding.
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d248f31-985f-4069-bdc1-5afb22ca14b1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:00:31 user nova-compute[74646]: No targets found.
Oct 26 16:00:31 user nova-compute[74646]: iSNS:
Oct 26 16:00:31 user nova-compute[74646]: No targets found.
Oct 26 16:00:31 user nova-compute[74646]: STATIC:
Oct 26 16:00:31 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a
Oct 26 16:00:31 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:00:31 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:00:31 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb
Oct 26 16:00:31 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:00:31 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:00:31 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509
Oct 26 16:00:31 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:00:31 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:00:31 user nova-compute[74646]: FIRMWARE:
Oct 26 16:00:31 user nova-compute[74646]: No targets found.
Oct 26 16:00:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:00:31 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:00:31 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-577894992',display_name='tempest-ServerActionsTestOtherB-server-577894992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-577894992',id=16,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8WuJBWWQ3dPKpsfd3pTt9BdyjBEif+cyL8w8Tg3VzJlkHtDxzbffk6KqqzEPT5s/X3OVnkganTQcqlWVpiRN+miRvt4exLQM5oDzUYlmj5/y40opmavHEPxTdEvfSLNw==',key_name='tempest-keypair-721457332',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5c99559f6003420bb1014bdb0f0988ff',ramdisk_id='',reservation_id='r-4yydauu2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1825400277',owner_user_name='tempest-ServerActionsTestOtherB-1825400277-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86031b2e164644e0a59efcd110ddf497',uuid=96a71d00-27f0-4dbe-88cb-e6f296178e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1494730225-network", "vif_mac": "fa:16:3e:7e:a4:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converting VIF {"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1494730225-network", "vif_mac": "fa:16:3e:7e:a4:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:00:31 user nova-compute[74646]:   <uuid>96a71d00-27f0-4dbe-88cb-e6f296178e90</uuid>
Oct 26 16:00:31 user nova-compute[74646]:   <name>instance-00000010</name>
Oct 26 16:00:31 user nova-compute[74646]:   <memory>2097152</memory>
Oct 26 16:00:31 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:00:31 user nova-compute[74646]:   <metadata>
Oct 26 16:00:31 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:00:31 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:00:31 user nova-compute[74646]:       <nova:name>tempest-ServerActionsTestOtherB-server-577894992</nova:name>
Oct 26 16:00:31 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:00:30</nova:creationTime>
Oct 26 16:00:31 user nova-compute[74646]:       <nova:flavor name="m1.small">
Oct 26 16:00:31 user nova-compute[74646]:         <nova:memory>2048</nova:memory>
Oct 26 16:00:31 user nova-compute[74646]:         <nova:disk>20</nova:disk>
Oct 26 16:00:31 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:00:31 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:00:31 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:00:31 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:00:31 user nova-compute[74646]:       <nova:owner>
Oct 26 16:00:31 user nova-compute[74646]:         <nova:user uuid="86031b2e164644e0a59efcd110ddf497">tempest-ServerActionsTestOtherB-1825400277-project-member</nova:user>
Oct 26 16:00:31 user nova-compute[74646]:         <nova:project uuid="5c99559f6003420bb1014bdb0f0988ff">tempest-ServerActionsTestOtherB-1825400277</nova:project>
Oct 26 16:00:31 user nova-compute[74646]:       </nova:owner>
Oct 26 16:00:31 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:00:31 user nova-compute[74646]:       <nova:ports>
Oct 26 16:00:31 user nova-compute[74646]:         <nova:port uuid="3e16bb7b-c1c2-4a11-aad9-2da2fbae632b">
Oct 26 16:00:31 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 16:00:31 user nova-compute[74646]:         </nova:port>
Oct 26 16:00:31 user nova-compute[74646]:       </nova:ports>
Oct 26 16:00:31 user nova-compute[74646]:     </nova:instance>
Oct 26 16:00:31 user nova-compute[74646]:   </metadata>
Oct 26 16:00:31 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:00:31 user nova-compute[74646]:     <system>
Oct 26 16:00:31 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:00:31 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:00:31 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:00:31 user nova-compute[74646]:       <entry name="serial">96a71d00-27f0-4dbe-88cb-e6f296178e90</entry>
Oct 26 16:00:31 user nova-compute[74646]:       <entry name="uuid">96a71d00-27f0-4dbe-88cb-e6f296178e90</entry>
Oct 26 16:00:31 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:00:31 user nova-compute[74646]:     </system>
Oct 26 16:00:31 user nova-compute[74646]:   </sysinfo>
Oct 26 16:00:31 user nova-compute[74646]:   <os>
Oct 26 16:00:31 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:00:31 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:00:31 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:00:31 user nova-compute[74646]:   </os>
Oct 26 16:00:31 user nova-compute[74646]:   <features>
Oct 26 16:00:31 user nova-compute[74646]:     <acpi/>
Oct 26 16:00:31 user nova-compute[74646]:     <apic/>
Oct 26 16:00:31 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:00:31 user nova-compute[74646]:   </features>
Oct 26 16:00:31 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:00:31 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:00:31 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:00:31 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:00:31 user nova-compute[74646]:   </clock>
Oct 26 16:00:31 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:00:31 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:00:31 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:00:31 user nova-compute[74646]:   </cpu>
Oct 26 16:00:31 user nova-compute[74646]:   <devices>
Oct 26 16:00:31 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:00:31 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:00:31 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk"/>
Oct 26 16:00:31 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:00:31 user nova-compute[74646]:     </disk>
Oct 26 16:00:31 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:00:31 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:00:31 user nova-compute[74646]:       <source dev="/dev/sdd"/>
Oct 26 16:00:31 user nova-compute[74646]:       <target dev="vdb" bus="virtio"/>
Oct 26 16:00:31 user nova-compute[74646]:       <serial>f149e265-10cd-4341-9baf-859d99ae7509</serial>
Oct 26 16:00:31 user nova-compute[74646]:     </disk>
Oct 26 16:00:31 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:00:31 user nova-compute[74646]:       <mac address="fa:16:3e:7e:a4:63"/>
Oct 26 16:00:31 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:00:31 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:00:31 user nova-compute[74646]:       <target dev="tap3e16bb7b-c1"/>
Oct 26 16:00:31 user nova-compute[74646]:     </interface>
Oct 26 16:00:31 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:00:31 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/console.log" append="off"/>
Oct 26 16:00:31 user nova-compute[74646]:     </serial>
Oct 26 16:00:31 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:00:31 user nova-compute[74646]:     <video>
Oct 26 16:00:31 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:00:31 user nova-compute[74646]:     </video>
Oct 26 16:00:31 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:00:31 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:00:31 user nova-compute[74646]:     </rng>
Oct 26 16:00:31 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:00:31 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:00:31 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:00:31 user nova-compute[74646]:     </memballoon>
Oct 26 16:00:31 user nova-compute[74646]:   </devices>
Oct 26 16:00:31 user nova-compute[74646]: </domain>
Oct 26 16:00:31 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-577894992',display_name='tempest-ServerActionsTestOtherB-server-577894992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-577894992',id=16,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8WuJBWWQ3dPKpsfd3pTt9BdyjBEif+cyL8w8Tg3VzJlkHtDxzbffk6KqqzEPT5s/X3OVnkganTQcqlWVpiRN+miRvt4exLQM5oDzUYlmj5/y40opmavHEPxTdEvfSLNw==',key_name='tempest-keypair-721457332',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5c99559f6003420bb1014bdb0f0988ff',ramdisk_id='',reservation_id='r-4yydauu2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1825400277',owner_user_name='tempest-ServerActionsTestOtherB-1825400277-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:00:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86031b2e164644e0a59efcd110ddf497',uuid=96a71d00-27f0-4dbe-88cb-e6f296178e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1494730225-network", "vif_mac": "fa:16:3e:7e:a4:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converting VIF {"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1494730225-network", "vif_mac": "fa:16:3e:7e:a4:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_vif [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05023755-74fa-5a87-9bba-64208721fb30', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c410c84-8eba-40e1-9df5-dc33d602032f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e16bb7b-c1, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e16bb7b-c1, col_values=(('qos', UUID('8eb542fa-0e37-40e8-8165-5aa3726af28f')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e16bb7b-c1, col_values=(('external_ids', {'iface-id': '3e16bb7b-c1c2-4a11-aad9-2da2fbae632b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:a4:63', 'vm-uuid': '96a71d00-27f0-4dbe-88cb-e6f296178e90'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2bca4ec-69d8-4f54-aa74-e4c43a5dc742]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:31 user nova-compute[74646]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:00:31 user nova-compute[74646]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:00:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:31 user nova-compute[74646]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:00:31 user nova-compute[74646]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:00:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e8543ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a'): ({'sdb'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Removing single pathed devices sdb {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:31 user nova-compute[74646]: INFO os_vif [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1')
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[651bb5df-f055-4464-a4a6-ba3790fc160b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d1d929-c4ec-47c8-b019-654c0a74a49f]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Flushing IO for device /dev/sdb {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[13843606-15f6-4d21-9e90-1d3b001d6fcf]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] No VIF found with MAC fa:16:3e:7e:a4:63, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[565050bf-c88f-4848-9c92-1a805d9493e1]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ac961a-7e52-4187-bf97-f221e09f9505]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a702b4e-9c05-4cfa-9846-0ac56dcb0381]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260]
Oct 26 16:00:31 user nova-compute[74646]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260] successful.
Oct 26 16:00:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0126e2d0-a57d-4e52-8332-c019c65ede8e]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.373s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] <== disconnect_volume: return (1529ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:00:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:00:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-5280cfd5-839c-4f5d-97cd-148331aed4b6 req-94c83509-4c85-4d2a-b337-261d9c4d4fc2 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:00:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5280cfd5-839c-4f5d-97cd-148331aed4b6 req-94c83509-4c85-4d2a-b337-261d9c4d4fc2 service nova] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5280cfd5-839c-4f5d-97cd-148331aed4b6 req-94c83509-4c85-4d2a-b337-261d9c4d4fc2 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5280cfd5-839c-4f5d-97cd-148331aed4b6 req-94c83509-4c85-4d2a-b337-261d9c4d4fc2 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-5280cfd5-839c-4f5d-97cd-148331aed4b6 req-94c83509-4c85-4d2a-b337-261d9c4d4fc2 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] No waiting events found dispatching network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:00:33 user nova-compute[74646]: WARNING nova.compute.manager [req-5280cfd5-839c-4f5d-97cd-148331aed4b6 req-94c83509-4c85-4d2a-b337-261d9c4d4fc2 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received unexpected event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b for instance with vm_state active and task_state resize_finish.
Oct 26 16:00:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:35 user nova-compute[74646]: INFO nova.compute.manager [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Terminating instance
Oct 26 16:00:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG nova.compute.manager [req-c82e514e-c1bb-42e8-ad3c-ad9191348375 req-10c3f954-3935-4310-b97b-a8cfb66ffd1e service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c82e514e-c1bb-42e8-ad3c-ad9191348375 req-10c3f954-3935-4310-b97b-a8cfb66ffd1e service nova] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c82e514e-c1bb-42e8-ad3c-ad9191348375 req-10c3f954-3935-4310-b97b-a8cfb66ffd1e service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c82e514e-c1bb-42e8-ad3c-ad9191348375 req-10c3f954-3935-4310-b97b-a8cfb66ffd1e service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG nova.compute.manager [req-c82e514e-c1bb-42e8-ad3c-ad9191348375 req-10c3f954-3935-4310-b97b-a8cfb66ffd1e service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] No waiting events found dispatching network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:00:35 user nova-compute[74646]: WARNING nova.compute.manager [req-c82e514e-c1bb-42e8-ad3c-ad9191348375 req-10c3f954-3935-4310-b97b-a8cfb66ffd1e service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received unexpected event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b for instance with vm_state active and task_state resize_finish.
Oct 26 16:00:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:00:35 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Instance running successfully.
Oct 26 16:00:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Failed to set time: agent not configured {{(pid=74646) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a81e1cd9-634f-453d-8eb5-0c7b9ac6d278 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] finish_migration finished successfully. {{(pid=74646) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG nova.compute.manager [req-213ff7b1-fe55-4c0b-b3e7-0c38b6c30156 req-d660e49d-d9e5-431d-ae39-3a5e5be5ba9a service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Received event network-vif-unplugged-d81f29ee-8954-4306-ad39-9634dd9c85af {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-213ff7b1-fe55-4c0b-b3e7-0c38b6c30156 req-d660e49d-d9e5-431d-ae39-3a5e5be5ba9a service nova] Acquiring lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-213ff7b1-fe55-4c0b-b3e7-0c38b6c30156 req-d660e49d-d9e5-431d-ae39-3a5e5be5ba9a service nova] Lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-213ff7b1-fe55-4c0b-b3e7-0c38b6c30156 req-d660e49d-d9e5-431d-ae39-3a5e5be5ba9a service nova] Lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG nova.compute.manager [req-213ff7b1-fe55-4c0b-b3e7-0c38b6c30156 req-d660e49d-d9e5-431d-ae39-3a5e5be5ba9a service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] No waiting events found dispatching network-vif-unplugged-d81f29ee-8954-4306-ad39-9634dd9c85af {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG nova.compute.manager [req-213ff7b1-fe55-4c0b-b3e7-0c38b6c30156 req-d660e49d-d9e5-431d-ae39-3a5e5be5ba9a service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Received event network-vif-unplugged-d81f29ee-8954-4306-ad39-9634dd9c85af for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:36 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Instance destroyed successfully.
Oct 26 16:00:36 user nova-compute[74646]: DEBUG nova.objects.instance [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lazy-loading 'resources' on Instance uuid ac760a1e-ead6-4a6f-90d0-0ecd10d7c600 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:58:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2007043401',display_name='tempest-VolumesAdminNegativeTest-server-2007043401',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2007043401',id=22,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:58:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1515df0bbff42d5be9f8ba40cdeb0da',ramdisk_id='',reservation_id='r-vbwziaxv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-464290099',owner_user_name='tempest-VolumesAdminNegativeTest-464290099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:58:34Z,user_data=None,user_id='05a35d09461745e1a1250ecdc2443a75',uuid=ac760a1e-ead6-4a6f-90d0-0ecd10d7c600,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d81f29ee-8954-4306-ad39-9634dd9c85af", "address": "fa:16:3e:19:1d:b3", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81f29ee-89", "ovs_interfaceid": "d81f29ee-8954-4306-ad39-9634dd9c85af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Converting VIF {"id": "d81f29ee-8954-4306-ad39-9634dd9c85af", "address": "fa:16:3e:19:1d:b3", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd81f29ee-89", "ovs_interfaceid": "d81f29ee-8954-4306-ad39-9634dd9c85af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:1d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d81f29ee-8954-4306-ad39-9634dd9c85af,network=Network(a23d40dd-77c0-4375-b256-1c5a6caa93ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81f29ee-89') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG os_vif [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:1d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d81f29ee-8954-4306-ad39-9634dd9c85af,network=Network(a23d40dd-77c0-4375-b256-1c5a6caa93ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81f29ee-89') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd81f29ee-89, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a370d37d-7d05-421f-be95-504d31090d4e) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:36 user nova-compute[74646]: INFO os_vif [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:1d:b3,bridge_name='br-int',has_traffic_filtering=True,id=d81f29ee-8954-4306-ad39-9634dd9c85af,network=Network(a23d40dd-77c0-4375-b256-1c5a6caa93ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd81f29ee-89')
Oct 26 16:00:36 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Deleting instance files /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600_del
Oct 26 16:00:36 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Deletion of /opt/stack/data/nova/instances/ac760a1e-ead6-4a6f-90d0-0ecd10d7c600_del complete
Oct 26 16:00:36 user nova-compute[74646]: INFO nova.compute.manager [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Took 0.76 seconds to destroy the instance on the hypervisor.
Oct 26 16:00:36 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:00:36 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:00:37 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Took 0.89 seconds to deallocate network for instance.
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:37 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Instance destroyed successfully.
Oct 26 16:00:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-587138455',display_name='tempest-ServerActionsTestOtherA-server-1879145648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-587138455',id=20,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbmmCHSiAv6wnl4y6udIFIXZEW/bOp74proj1U5AEM0+QPtfownIPyTApMq9brABhT3IwnIfBs9QKjt04IQsymoSPOFRANJzeHzmMShY1+CCmigklKl+J5T9ZIigvKl+w==',key_name='tempest-keypair-1281352566',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:58:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-y115hib0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:00:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=b79f5ea4-ea88-41b4-8ca2-116b5b6408de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=c3fa2d89-235f-4939-8eff-e59c02c578fe,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fa2d89-23') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_vif [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=c3fa2d89-235f-4939-8eff-e59c02c578fe,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fa2d89-23') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3fa2d89-23, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=259d1510-14b0-4356-9dcd-64fa1f06f348) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:37 user nova-compute[74646]: INFO os_vif [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=c3fa2d89-235f-4939-8eff-e59c02c578fe,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fa2d89-23')
Oct 26 16:00:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTufjnmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:00:37 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[95278eaa-8906-4662-8d13-f3fcb35bd5cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:00:37 user nova-compute[74646]: No targets found.
Oct 26 16:00:37 user nova-compute[74646]: iSNS:
Oct 26 16:00:37 user nova-compute[74646]: No targets found.
Oct 26 16:00:37 user nova-compute[74646]: STATIC:
Oct 26 16:00:37 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb
Oct 26 16:00:37 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:00:37 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:00:37 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509
Oct 26 16:00:37 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:00:37 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:00:37 user nova-compute[74646]: FIRMWARE:
Oct 26 16:00:37 user nova-compute[74646]: No targets found.
Oct 26 16:00:37 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:00:37 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:00:37 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf93a4e7-ef3a-4e84-bf19-edb27efc7c1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b20be3-4500-48ea-93e7-23ac3d46c23c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:37 user nova-compute[74646]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:00:37 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:00:37 user nova-compute[74646]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:00:37 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e0183f40>, {}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Disconnecting from: [] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.097s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] <== disconnect_volume: return (98ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:00:37 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Deleting instance files /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de_del
Oct 26 16:00:37 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Deletion of /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de_del complete
Oct 26 16:00:37 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:00:37 user nova-compute[74646]: INFO nova.virt.block_device [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Booting with volume f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a at /dev/vdb
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-c0059f0c-b3ec-447c-b49d-d90f6d18fa18 req-c92eb491-0ebf-4c4a-a77b-3ac18dbc8a5b service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Received event network-vif-deleted-d81f29ee-8954-4306-ad39-9634dd9c85af {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:00:37 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Deleted allocations for instance ac760a1e-ead6-4a6f-90d0-0ecd10d7c600
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_brick.utils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5ed436-d196-43e0-a069-2ad775c01471]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1550dc8e-8557-4976-afa9-fed7e6a6482b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e508493f-c73a-4d21-b5b3-ff4e87fb83e9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3cb2b3-8bb6-4dae-be86-1fb3e53c5dd6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-fbaec5a3-92f4-4eec-9167-88a4f54a7ad6 req-2565d4c9-495a-4362-bcb7-af729a44eac1 service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Received event network-vif-plugged-d81f29ee-8954-4306-ad39-9634dd9c85af {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fbaec5a3-92f4-4eec-9167-88a4f54a7ad6 req-2565d4c9-495a-4362-bcb7-af729a44eac1 service nova] Acquiring lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fbaec5a3-92f4-4eec-9167-88a4f54a7ad6 req-2565d4c9-495a-4362-bcb7-af729a44eac1 service nova] Lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fbaec5a3-92f4-4eec-9167-88a4f54a7ad6 req-2565d4c9-495a-4362-bcb7-af729a44eac1 service nova] Lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-fbaec5a3-92f4-4eec-9167-88a4f54a7ad6 req-2565d4c9-495a-4362-bcb7-af729a44eac1 service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] No waiting events found dispatching network-vif-plugged-d81f29ee-8954-4306-ad39-9634dd9c85af {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:00:37 user nova-compute[74646]: WARNING nova.compute.manager [req-fbaec5a3-92f4-4eec-9167-88a4f54a7ad6 req-2565d4c9-495a-4362-bcb7-af729a44eac1 service nova] [instance: ac760a1e-ead6-4a6f-90d0-0ecd10d7c600] Received unexpected event network-vif-plugged-d81f29ee-8954-4306-ad39-9634dd9c85af for instance with vm_state deleted and task_state None.
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:00:37 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:00:37 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[50594ff5-5779-4c3d-9218-3a1aef0d3071]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:00:38 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:00:38 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:00:38 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:00:38 user nova-compute[74646]: DEBUG os_brick.utils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:00:38 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Updating existing volume attachment record: 99376b57-ac3f-493d-a626-9614a089c399 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:00:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95136809-27e8-4611-beec-b63d491f471c tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "ac760a1e-ead6-4a6f-90d0-0ecd10d7c600" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.524s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:00:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:00:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:00:53 user nova-compute[74646]: INFO nova.compute.manager [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Detaching volume 39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb
Oct 26 16:00:53 user nova-compute[74646]: INFO nova.virt.block_device [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Attempting to driver detach volume 39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb from mountpoint /dev/vdb
Oct 26 16:00:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Attempting to detach device vdb from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:00:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:00:53 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:00:53 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 16:00:53 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:00:53 user nova-compute[74646]:   <serial>39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb</serial>
Oct 26 16:00:53 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:00:53 user nova-compute[74646]: </disk>
Oct 26 16:00:53 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:00:53 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Successfully detached device vdb from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the persistent domain config.
Oct 26 16:00:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:00:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:00:53 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:00:53 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 16:00:53 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:00:53 user nova-compute[74646]:   <serial>39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb</serial>
Oct 26 16:00:53 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:00:53 user nova-compute[74646]: </disk>
Oct 26 16:00:53 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:00:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:00:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:00:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Acquiring lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:01:04 user nova-compute[74646]: INFO nova.compute.claims [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Claim successful on node user
Oct 26 16:01:04 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG nova.network.neutron [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:01:04 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:01:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG nova.policy [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fca6889c7d7c479fae967215bbb5ca12', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8f1aa9710cad4f8493c3ed49167ff876', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:01:04 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Creating image(s)
Oct 26 16:01:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Acquiring lock "/opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "/opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "/opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.201s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.184s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk 1073741824" returned: 0 in 0.057s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG nova.network.neutron [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Successfully created port: e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.201s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Checking if we can resize image /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Cannot resize image /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Ensure instance console log exists: /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.network.neutron [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Successfully updated port: e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Acquiring lock "refresh_cache-696aeb6d-33b0-4fd5-9b03-91375b0c30dc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Acquired lock "refresh_cache-696aeb6d-33b0-4fd5-9b03-91375b0c30dc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.network.neutron [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-2be8d98f-a23d-4080-a0a5-bf939d9170ab req-8a376295-4885-474b-9980-88c3514f2190 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Received event network-changed-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-2be8d98f-a23d-4080-a0a5-bf939d9170ab req-8a376295-4885-474b-9980-88c3514f2190 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Refreshing instance network info cache due to event network-changed-e76cc0df-d5d8-4cd5-abf4-cec6e536db86. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2be8d98f-a23d-4080-a0a5-bf939d9170ab req-8a376295-4885-474b-9980-88c3514f2190 service nova] Acquiring lock "refresh_cache-696aeb6d-33b0-4fd5-9b03-91375b0c30dc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.network.neutron [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.network.neutron [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Updating instance_info_cache with network_info: [{"id": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "address": "fa:16:3e:fd:e3:3f", "network": {"id": "0c31a8ed-93d5-4264-a423-1be36f607e77", "bridge": "br-int", "label": "tempest-TestStampPattern-1455596049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1aa9710cad4f8493c3ed49167ff876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76cc0df-d5", "ovs_interfaceid": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Releasing lock "refresh_cache-696aeb6d-33b0-4fd5-9b03-91375b0c30dc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Instance network_info: |[{"id": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "address": "fa:16:3e:fd:e3:3f", "network": {"id": "0c31a8ed-93d5-4264-a423-1be36f607e77", "bridge": "br-int", "label": "tempest-TestStampPattern-1455596049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1aa9710cad4f8493c3ed49167ff876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76cc0df-d5", "ovs_interfaceid": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2be8d98f-a23d-4080-a0a5-bf939d9170ab req-8a376295-4885-474b-9980-88c3514f2190 service nova] Acquired lock "refresh_cache-696aeb6d-33b0-4fd5-9b03-91375b0c30dc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.network.neutron [req-2be8d98f-a23d-4080-a0a5-bf939d9170ab req-8a376295-4885-474b-9980-88c3514f2190 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Refreshing network info cache for port e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Start _get_guest_xml network_info=[{"id": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "address": "fa:16:3e:fd:e3:3f", "network": {"id": "0c31a8ed-93d5-4264-a423-1be36f607e77", "bridge": "br-int", "label": "tempest-TestStampPattern-1455596049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1aa9710cad4f8493c3ed49167ff876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76cc0df-d5", "ovs_interfaceid": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:01:06 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:01:06 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-495263237',display_name='tempest-TestStampPattern-server-495263237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-495263237',id=24,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwCHo1J75VKv6tOxJOFueps6MpuV3GNceWf93f7UVDDO8T2GQYqajdkvEwTTWSfQ1S7ZSR5+y4w9wZ0WrpSIx82lz1s6T8QHdhxm4ba049afyzdgsTZ79LJIlj3whnfOQ==',key_name='tempest-TestStampPattern-2091035763',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f1aa9710cad4f8493c3ed49167ff876',ramdisk_id='',reservation_id='r-fs733gyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-12700612',owner_user_name='tempest-TestStampPattern-12700612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:01:05Z,user_data=None,user_id='fca6889c7d7c479fae967215bbb5ca12',uuid=696aeb6d-33b0-4fd5-9b03-91375b0c30dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "address": "fa:16:3e:fd:e3:3f", "network": {"id": "0c31a8ed-93d5-4264-a423-1be36f607e77", "bridge": "br-int", "label": "tempest-TestStampPattern-1455596049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1aa9710cad4f8493c3ed49167ff876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76cc0df-d5", "ovs_interfaceid": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Converting VIF {"id": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "address": "fa:16:3e:fd:e3:3f", "network": {"id": "0c31a8ed-93d5-4264-a423-1be36f607e77", "bridge": "br-int", "label": "tempest-TestStampPattern-1455596049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1aa9710cad4f8493c3ed49167ff876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76cc0df-d5", "ovs_interfaceid": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:3f,bridge_name='br-int',has_traffic_filtering=True,id=e76cc0df-d5d8-4cd5-abf4-cec6e536db86,network=Network(0c31a8ed-93d5-4264-a423-1be36f607e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76cc0df-d5') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.objects.instance [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lazy-loading 'pci_devices' on Instance uuid 696aeb6d-33b0-4fd5-9b03-91375b0c30dc {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:01:06 user nova-compute[74646]:   <uuid>696aeb6d-33b0-4fd5-9b03-91375b0c30dc</uuid>
Oct 26 16:01:06 user nova-compute[74646]:   <name>instance-00000018</name>
Oct 26 16:01:06 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:01:06 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:01:06 user nova-compute[74646]:   <metadata>
Oct 26 16:01:06 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:01:06 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:01:06 user nova-compute[74646]:       <nova:name>tempest-TestStampPattern-server-495263237</nova:name>
Oct 26 16:01:06 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:01:06</nova:creationTime>
Oct 26 16:01:06 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:01:06 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:01:06 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:01:06 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:01:06 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:01:06 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:01:06 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:01:06 user nova-compute[74646]:       <nova:owner>
Oct 26 16:01:06 user nova-compute[74646]:         <nova:user uuid="fca6889c7d7c479fae967215bbb5ca12">tempest-TestStampPattern-12700612-project-member</nova:user>
Oct 26 16:01:06 user nova-compute[74646]:         <nova:project uuid="8f1aa9710cad4f8493c3ed49167ff876">tempest-TestStampPattern-12700612</nova:project>
Oct 26 16:01:06 user nova-compute[74646]:       </nova:owner>
Oct 26 16:01:06 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:01:06 user nova-compute[74646]:       <nova:ports>
Oct 26 16:01:06 user nova-compute[74646]:         <nova:port uuid="e76cc0df-d5d8-4cd5-abf4-cec6e536db86">
Oct 26 16:01:06 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 16:01:06 user nova-compute[74646]:         </nova:port>
Oct 26 16:01:06 user nova-compute[74646]:       </nova:ports>
Oct 26 16:01:06 user nova-compute[74646]:     </nova:instance>
Oct 26 16:01:06 user nova-compute[74646]:   </metadata>
Oct 26 16:01:06 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:01:06 user nova-compute[74646]:     <system>
Oct 26 16:01:06 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:01:06 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:01:06 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:01:06 user nova-compute[74646]:       <entry name="serial">696aeb6d-33b0-4fd5-9b03-91375b0c30dc</entry>
Oct 26 16:01:06 user nova-compute[74646]:       <entry name="uuid">696aeb6d-33b0-4fd5-9b03-91375b0c30dc</entry>
Oct 26 16:01:06 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:01:06 user nova-compute[74646]:     </system>
Oct 26 16:01:06 user nova-compute[74646]:   </sysinfo>
Oct 26 16:01:06 user nova-compute[74646]:   <os>
Oct 26 16:01:06 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:01:06 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:01:06 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:01:06 user nova-compute[74646]:   </os>
Oct 26 16:01:06 user nova-compute[74646]:   <features>
Oct 26 16:01:06 user nova-compute[74646]:     <acpi/>
Oct 26 16:01:06 user nova-compute[74646]:     <apic/>
Oct 26 16:01:06 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:01:06 user nova-compute[74646]:   </features>
Oct 26 16:01:06 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:01:06 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:01:06 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:01:06 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:01:06 user nova-compute[74646]:   </clock>
Oct 26 16:01:06 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:01:06 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:01:06 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:01:06 user nova-compute[74646]:   </cpu>
Oct 26 16:01:06 user nova-compute[74646]:   <devices>
Oct 26 16:01:06 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:01:06 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:01:06 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk"/>
Oct 26 16:01:06 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:01:06 user nova-compute[74646]:     </disk>
Oct 26 16:01:06 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:01:06 user nova-compute[74646]:       <mac address="fa:16:3e:fd:e3:3f"/>
Oct 26 16:01:06 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:01:06 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:01:06 user nova-compute[74646]:       <target dev="tape76cc0df-d5"/>
Oct 26 16:01:06 user nova-compute[74646]:     </interface>
Oct 26 16:01:06 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:01:06 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/console.log" append="off"/>
Oct 26 16:01:06 user nova-compute[74646]:     </serial>
Oct 26 16:01:06 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:01:06 user nova-compute[74646]:     <video>
Oct 26 16:01:06 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:01:06 user nova-compute[74646]:     </video>
Oct 26 16:01:06 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:01:06 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:01:06 user nova-compute[74646]:     </rng>
Oct 26 16:01:06 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:01:06 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:01:06 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:01:06 user nova-compute[74646]:     </memballoon>
Oct 26 16:01:06 user nova-compute[74646]:   </devices>
Oct 26 16:01:06 user nova-compute[74646]: </domain>
Oct 26 16:01:06 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-495263237',display_name='tempest-TestStampPattern-server-495263237',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-495263237',id=24,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwCHo1J75VKv6tOxJOFueps6MpuV3GNceWf93f7UVDDO8T2GQYqajdkvEwTTWSfQ1S7ZSR5+y4w9wZ0WrpSIx82lz1s6T8QHdhxm4ba049afyzdgsTZ79LJIlj3whnfOQ==',key_name='tempest-TestStampPattern-2091035763',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8f1aa9710cad4f8493c3ed49167ff876',ramdisk_id='',reservation_id='r-fs733gyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-12700612',owner_user_name='tempest-TestStampPattern-12700612-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:01:05Z,user_data=None,user_id='fca6889c7d7c479fae967215bbb5ca12',uuid=696aeb6d-33b0-4fd5-9b03-91375b0c30dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "address": "fa:16:3e:fd:e3:3f", "network": {"id": "0c31a8ed-93d5-4264-a423-1be36f607e77", "bridge": "br-int", "label": "tempest-TestStampPattern-1455596049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1aa9710cad4f8493c3ed49167ff876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76cc0df-d5", "ovs_interfaceid": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Converting VIF {"id": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "address": "fa:16:3e:fd:e3:3f", "network": {"id": "0c31a8ed-93d5-4264-a423-1be36f607e77", "bridge": "br-int", "label": "tempest-TestStampPattern-1455596049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1aa9710cad4f8493c3ed49167ff876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76cc0df-d5", "ovs_interfaceid": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:3f,bridge_name='br-int',has_traffic_filtering=True,id=e76cc0df-d5d8-4cd5-abf4-cec6e536db86,network=Network(0c31a8ed-93d5-4264-a423-1be36f607e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76cc0df-d5') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG os_vif [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:3f,bridge_name='br-int',has_traffic_filtering=True,id=e76cc0df-d5d8-4cd5-abf4-cec6e536db86,network=Network(0c31a8ed-93d5-4264-a423-1be36f607e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76cc0df-d5') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3148e99f-6d61-5390-bd43-5d8224ded059', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape76cc0df-d5, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape76cc0df-d5, col_values=(('qos', UUID('e0a77cc4-1af1-4ff6-adf8-f9a444bed03f')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape76cc0df-d5, col_values=(('external_ids', {'iface-id': 'e76cc0df-d5d8-4cd5-abf4-cec6e536db86', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:e3:3f', 'vm-uuid': '696aeb6d-33b0-4fd5-9b03-91375b0c30dc'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:06 user nova-compute[74646]: INFO os_vif [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:e3:3f,bridge_name='br-int',has_traffic_filtering=True,id=e76cc0df-d5d8-4cd5-abf4-cec6e536db86,network=Network(0c31a8ed-93d5-4264-a423-1be36f607e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76cc0df-d5')
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:01:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] No VIF found with MAC fa:16:3e:fd:e3:3f, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:01:07 user nova-compute[74646]: DEBUG nova.network.neutron [req-2be8d98f-a23d-4080-a0a5-bf939d9170ab req-8a376295-4885-474b-9980-88c3514f2190 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Updated VIF entry in instance network info cache for port e76cc0df-d5d8-4cd5-abf4-cec6e536db86. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:01:07 user nova-compute[74646]: DEBUG nova.network.neutron [req-2be8d98f-a23d-4080-a0a5-bf939d9170ab req-8a376295-4885-474b-9980-88c3514f2190 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Updating instance_info_cache with network_info: [{"id": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "address": "fa:16:3e:fd:e3:3f", "network": {"id": "0c31a8ed-93d5-4264-a423-1be36f607e77", "bridge": "br-int", "label": "tempest-TestStampPattern-1455596049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1aa9710cad4f8493c3ed49167ff876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76cc0df-d5", "ovs_interfaceid": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:01:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2be8d98f-a23d-4080-a0a5-bf939d9170ab req-8a376295-4885-474b-9980-88c3514f2190 service nova] Releasing lock "refresh_cache-696aeb6d-33b0-4fd5-9b03-91375b0c30dc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:01:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-686578a2-5c20-4cec-9fd3-6b5575454851 req-697c19be-702e-49ed-8cb7-f7530ab97181 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Received event network-vif-plugged-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-686578a2-5c20-4cec-9fd3-6b5575454851 req-697c19be-702e-49ed-8cb7-f7530ab97181 service nova] Acquiring lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-686578a2-5c20-4cec-9fd3-6b5575454851 req-697c19be-702e-49ed-8cb7-f7530ab97181 service nova] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-686578a2-5c20-4cec-9fd3-6b5575454851 req-697c19be-702e-49ed-8cb7-f7530ab97181 service nova] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-686578a2-5c20-4cec-9fd3-6b5575454851 req-697c19be-702e-49ed-8cb7-f7530ab97181 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] No waiting events found dispatching network-vif-plugged-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:01:08 user nova-compute[74646]: WARNING nova.compute.manager [req-686578a2-5c20-4cec-9fd3-6b5575454851 req-697c19be-702e-49ed-8cb7-f7530ab97181 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Received unexpected event network-vif-plugged-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 for instance with vm_state building and task_state spawning.
Oct 26 16:01:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:01:10 user nova-compute[74646]: INFO nova.compute.claims [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Claim successful on node user
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-7541940e-c020-4632-a7eb-320a6266a07c req-160b9063-2979-4487-a8f7-4eb78624791e service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Received event network-vif-plugged-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7541940e-c020-4632-a7eb-320a6266a07c req-160b9063-2979-4487-a8f7-4eb78624791e service nova] Acquiring lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7541940e-c020-4632-a7eb-320a6266a07c req-160b9063-2979-4487-a8f7-4eb78624791e service nova] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7541940e-c020-4632-a7eb-320a6266a07c req-160b9063-2979-4487-a8f7-4eb78624791e service nova] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-7541940e-c020-4632-a7eb-320a6266a07c req-160b9063-2979-4487-a8f7-4eb78624791e service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] No waiting events found dispatching network-vif-plugged-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:01:10 user nova-compute[74646]: WARNING nova.compute.manager [req-7541940e-c020-4632-a7eb-320a6266a07c req-160b9063-2979-4487-a8f7-4eb78624791e service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Received unexpected event network-vif-plugged-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 for instance with vm_state building and task_state spawning.
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:01:10 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Instance spawned successfully.
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.550s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.network.neutron [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:01:10 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:01:10 user nova-compute[74646]: INFO nova.compute.manager [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Took 5.77 seconds to spawn the instance on the hypervisor.
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG nova.policy [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abd7a869c235467ca4da99867c6bc0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e848952345455183c15fee816b6f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:01:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:10 user nova-compute[74646]: INFO nova.virt.block_device [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Booting with blank volume at /dev/vda
Oct 26 16:01:10 user nova-compute[74646]: INFO nova.compute.manager [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Took 6.60 seconds to build instance.
Oct 26 16:01:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e2a9b589-c667-450c-89f1-906164d6205d tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.723s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Successfully created port: a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:01:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Successfully updated port: a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:01:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:01:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquired lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:01:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:01:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-944d81fa-cb46-4153-9d40-a093d3437d17 req-36f49780-6fc3-4643-a60d-ed398f2bd7d3 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-changed-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-944d81fa-cb46-4153-9d40-a093d3437d17 req-36f49780-6fc3-4643-a60d-ed398f2bd7d3 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Refreshing instance network info cache due to event network-changed-a15cdcab-84af-42b2-bf76-a1c3027ee207. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:01:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-944d81fa-cb46-4153-9d40-a093d3437d17 req-36f49780-6fc3-4643-a60d-ed398f2bd7d3 service nova] Acquiring lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:01:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:01:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Updating instance_info_cache with network_info: [{"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:01:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Releasing lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:01:12 user nova-compute[74646]: DEBUG nova.compute.manager [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Instance network_info: |[{"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:01:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-944d81fa-cb46-4153-9d40-a093d3437d17 req-36f49780-6fc3-4643-a60d-ed398f2bd7d3 service nova] Acquired lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:01:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-944d81fa-cb46-4153-9d40-a093d3437d17 req-36f49780-6fc3-4643-a60d-ed398f2bd7d3 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Refreshing network info cache for port a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:01:13 user nova-compute[74646]: DEBUG nova.network.neutron [req-944d81fa-cb46-4153-9d40-a093d3437d17 req-36f49780-6fc3-4643-a60d-ed398f2bd7d3 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Updated VIF entry in instance network info cache for port a15cdcab-84af-42b2-bf76-a1c3027ee207. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:01:13 user nova-compute[74646]: DEBUG nova.network.neutron [req-944d81fa-cb46-4153-9d40-a093d3437d17 req-36f49780-6fc3-4643-a60d-ed398f2bd7d3 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Updating instance_info_cache with network_info: [{"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:01:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-944d81fa-cb46-4153-9d40-a093d3437d17 req-36f49780-6fc3-4643-a60d-ed398f2bd7d3 service nova] Releasing lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:01:14 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 is timed out.
Oct 26 16:01:14 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Successfully detached device vdb from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the live domain config.
Oct 26 16:01:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ISvqhgOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:01:14 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a092ff62-3b80-466d-9a00-89514ffd2838]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:01:14 user nova-compute[74646]: No targets found.
Oct 26 16:01:14 user nova-compute[74646]: iSNS:
Oct 26 16:01:14 user nova-compute[74646]: No targets found.
Oct 26 16:01:14 user nova-compute[74646]: STATIC:
Oct 26 16:01:14 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb
Oct 26 16:01:14 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:01:14 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:01:14 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509
Oct 26 16:01:14 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:01:14 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:01:14 user nova-compute[74646]: FIRMWARE:
Oct 26 16:01:14 user nova-compute[74646]: No targets found.
Oct 26 16:01:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:01:14 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:01:14 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[10303979-20a3-43e9-b2c1-d009eeb269ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fd8067-c112-4884-a0cc-8f7c183d16f3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:01:14 user nova-compute[74646]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:01:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb (non-flash)
Oct 26 16:01:14 user nova-compute[74646]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:01:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e81c9fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb'): ({'sdc'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Removing single pathed devices sdc {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3e46cc-fb39-4b51-a491-2ff2215aa6c4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5593333d-09f0-4dde-989d-d2180ff68f27]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Flushing IO for device /dev/sdc {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6de88bf-76e3-4fcb-b95e-14dc68a8cd2c]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca50a07a-6cee-46b7-bcb7-e5ffc7da622c]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[86655d29-b713-4d64-8c45-b4a73162bddf]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbd8403-e948-48d6-853e-2ac895da2aae]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb, portal: 172.16.0.220,3260]
Oct 26 16:01:14 user nova-compute[74646]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb, portal: 172.16.0.220,3260] successful.
Oct 26 16:01:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:39e0f653-cdd1-4ed7-a66a-b98cdbf1bfdb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb483fe0-0a0f-4241-8883-44db63cde507]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] <== disconnect_volume: return (330ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:01:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:01:15 user nova-compute[74646]: DEBUG nova.objects.instance [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lazy-loading 'flavor' on Instance uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:01:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-741263e4-8456-408e-aa86-d95826a9d3e6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.015s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "cd751613-c043-4903-b45c-1f19dccb0acb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "cd751613-c043-4903-b45c-1f19dccb0acb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:20 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:01:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:20 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:01:20 user nova-compute[74646]: INFO nova.compute.claims [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Claim successful on node user
Oct 26 16:01:21 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.514s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:01:21 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:01:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG nova.policy [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b57a8707539042deafe65215e10974eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '94630fc764f54e5782d3551bfe65e882', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:01:21 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Creating image(s)
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "/opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "/opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.198s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.228s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk 1073741824" returned: 0 in 0.065s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.202s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Successfully created port: 19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Cannot resize image /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Ensure instance console log exists: /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Successfully updated port: 19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-52e813e5-69e3-4b4d-8234-f31c29b22a78 req-b7c48f43-4b4b-4109-b61c-2a5a8aae042c service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Received event network-changed-19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-52e813e5-69e3-4b4d-8234-f31c29b22a78 req-b7c48f43-4b4b-4109-b61c-2a5a8aae042c service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Refreshing instance network info cache due to event network-changed-19fab0cc-b1c5-471b-8fae-30eec3d6659c. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-52e813e5-69e3-4b4d-8234-f31c29b22a78 req-b7c48f43-4b4b-4109-b61c-2a5a8aae042c service nova] Acquiring lock "refresh_cache-cd751613-c043-4903-b45c-1f19dccb0acb" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-52e813e5-69e3-4b4d-8234-f31c29b22a78 req-b7c48f43-4b4b-4109-b61c-2a5a8aae042c service nova] Acquired lock "refresh_cache-cd751613-c043-4903-b45c-1f19dccb0acb" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG nova.network.neutron [req-52e813e5-69e3-4b4d-8234-f31c29b22a78 req-b7c48f43-4b4b-4109-b61c-2a5a8aae042c service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Refreshing network info cache for port 19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:01:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "refresh_cache-cd751613-c043-4903-b45c-1f19dccb0acb" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.network.neutron [req-52e813e5-69e3-4b4d-8234-f31c29b22a78 req-b7c48f43-4b4b-4109-b61c-2a5a8aae042c service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.network.neutron [req-52e813e5-69e3-4b4d-8234-f31c29b22a78 req-b7c48f43-4b4b-4109-b61c-2a5a8aae042c service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-52e813e5-69e3-4b4d-8234-f31c29b22a78 req-b7c48f43-4b4b-4109-b61c-2a5a8aae042c service nova] Releasing lock "refresh_cache-cd751613-c043-4903-b45c-1f19dccb0acb" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquired lock "refresh_cache-cd751613-c043-4903-b45c-1f19dccb0acb" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Updating instance_info_cache with network_info: [{"id": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "address": "fa:16:3e:07:b0:59", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19fab0cc-b1", "ovs_interfaceid": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Releasing lock "refresh_cache-cd751613-c043-4903-b45c-1f19dccb0acb" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Instance network_info: |[{"id": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "address": "fa:16:3e:07:b0:59", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19fab0cc-b1", "ovs_interfaceid": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Start _get_guest_xml network_info=[{"id": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "address": "fa:16:3e:07:b0:59", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19fab0cc-b1", "ovs_interfaceid": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:01:23 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:01:23 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-961067970',display_name='tempest-VolumesSnapshotTestJSON-instance-961067970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-961067970',id=26,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQX2EOflT3LIH0+4IqtbGMfMknrvrujSBmqe3/EFvvUBhyvMkdPmcNQzcLIKjdnAAYNgcKX5T+MLJ0BofI3T2uBI8uDMjnY8HZDayyhQEx13a7AvaXRmgSuqSh0C7I8Bg==',key_name='tempest-keypair-976819839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94630fc764f54e5782d3551bfe65e882',ramdisk_id='',reservation_id='r-9orvcfkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1332594439',owner_user_name='tempest-VolumesSnapshotTestJSON-1332594439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:01:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b57a8707539042deafe65215e10974eb',uuid=cd751613-c043-4903-b45c-1f19dccb0acb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "address": "fa:16:3e:07:b0:59", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19fab0cc-b1", "ovs_interfaceid": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Converting VIF {"id": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "address": "fa:16:3e:07:b0:59", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19fab0cc-b1", "ovs_interfaceid": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:b0:59,bridge_name='br-int',has_traffic_filtering=True,id=19fab0cc-b1c5-471b-8fae-30eec3d6659c,network=Network(a8f622c2-5f60-4987-ad67-fe6d77ba5a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19fab0cc-b1') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.objects.instance [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lazy-loading 'pci_devices' on Instance uuid cd751613-c043-4903-b45c-1f19dccb0acb {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:01:23 user nova-compute[74646]:   <uuid>cd751613-c043-4903-b45c-1f19dccb0acb</uuid>
Oct 26 16:01:23 user nova-compute[74646]:   <name>instance-0000001a</name>
Oct 26 16:01:23 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:01:23 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:01:23 user nova-compute[74646]:   <metadata>
Oct 26 16:01:23 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:01:23 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:01:23 user nova-compute[74646]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-961067970</nova:name>
Oct 26 16:01:23 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:01:23</nova:creationTime>
Oct 26 16:01:23 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:01:23 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:01:23 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:01:23 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:01:23 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:01:23 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:01:23 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:01:23 user nova-compute[74646]:       <nova:owner>
Oct 26 16:01:23 user nova-compute[74646]:         <nova:user uuid="b57a8707539042deafe65215e10974eb">tempest-VolumesSnapshotTestJSON-1332594439-project-member</nova:user>
Oct 26 16:01:23 user nova-compute[74646]:         <nova:project uuid="94630fc764f54e5782d3551bfe65e882">tempest-VolumesSnapshotTestJSON-1332594439</nova:project>
Oct 26 16:01:23 user nova-compute[74646]:       </nova:owner>
Oct 26 16:01:23 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:01:23 user nova-compute[74646]:       <nova:ports>
Oct 26 16:01:23 user nova-compute[74646]:         <nova:port uuid="19fab0cc-b1c5-471b-8fae-30eec3d6659c">
Oct 26 16:01:23 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 16:01:23 user nova-compute[74646]:         </nova:port>
Oct 26 16:01:23 user nova-compute[74646]:       </nova:ports>
Oct 26 16:01:23 user nova-compute[74646]:     </nova:instance>
Oct 26 16:01:23 user nova-compute[74646]:   </metadata>
Oct 26 16:01:23 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:01:23 user nova-compute[74646]:     <system>
Oct 26 16:01:23 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:01:23 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:01:23 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:01:23 user nova-compute[74646]:       <entry name="serial">cd751613-c043-4903-b45c-1f19dccb0acb</entry>
Oct 26 16:01:23 user nova-compute[74646]:       <entry name="uuid">cd751613-c043-4903-b45c-1f19dccb0acb</entry>
Oct 26 16:01:23 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:01:23 user nova-compute[74646]:     </system>
Oct 26 16:01:23 user nova-compute[74646]:   </sysinfo>
Oct 26 16:01:23 user nova-compute[74646]:   <os>
Oct 26 16:01:23 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:01:23 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:01:23 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:01:23 user nova-compute[74646]:   </os>
Oct 26 16:01:23 user nova-compute[74646]:   <features>
Oct 26 16:01:23 user nova-compute[74646]:     <acpi/>
Oct 26 16:01:23 user nova-compute[74646]:     <apic/>
Oct 26 16:01:23 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:01:23 user nova-compute[74646]:   </features>
Oct 26 16:01:23 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:01:23 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:01:23 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:01:23 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:01:23 user nova-compute[74646]:   </clock>
Oct 26 16:01:23 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:01:23 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:01:23 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:01:23 user nova-compute[74646]:   </cpu>
Oct 26 16:01:23 user nova-compute[74646]:   <devices>
Oct 26 16:01:23 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:01:23 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:01:23 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk"/>
Oct 26 16:01:23 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:01:23 user nova-compute[74646]:     </disk>
Oct 26 16:01:23 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:01:23 user nova-compute[74646]:       <mac address="fa:16:3e:07:b0:59"/>
Oct 26 16:01:23 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:01:23 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:01:23 user nova-compute[74646]:       <target dev="tap19fab0cc-b1"/>
Oct 26 16:01:23 user nova-compute[74646]:     </interface>
Oct 26 16:01:23 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:01:23 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/console.log" append="off"/>
Oct 26 16:01:23 user nova-compute[74646]:     </serial>
Oct 26 16:01:23 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:01:23 user nova-compute[74646]:     <video>
Oct 26 16:01:23 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:01:23 user nova-compute[74646]:     </video>
Oct 26 16:01:23 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:01:23 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:01:23 user nova-compute[74646]:     </rng>
Oct 26 16:01:23 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:01:23 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:01:23 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:01:23 user nova-compute[74646]:     </memballoon>
Oct 26 16:01:23 user nova-compute[74646]:   </devices>
Oct 26 16:01:23 user nova-compute[74646]: </domain>
Oct 26 16:01:23 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-961067970',display_name='tempest-VolumesSnapshotTestJSON-instance-961067970',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-961067970',id=26,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQX2EOflT3LIH0+4IqtbGMfMknrvrujSBmqe3/EFvvUBhyvMkdPmcNQzcLIKjdnAAYNgcKX5T+MLJ0BofI3T2uBI8uDMjnY8HZDayyhQEx13a7AvaXRmgSuqSh0C7I8Bg==',key_name='tempest-keypair-976819839',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='94630fc764f54e5782d3551bfe65e882',ramdisk_id='',reservation_id='r-9orvcfkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1332594439',owner_user_name='tempest-VolumesSnapshotTestJSON-1332594439-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:01:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b57a8707539042deafe65215e10974eb',uuid=cd751613-c043-4903-b45c-1f19dccb0acb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "address": "fa:16:3e:07:b0:59", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19fab0cc-b1", "ovs_interfaceid": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Converting VIF {"id": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "address": "fa:16:3e:07:b0:59", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19fab0cc-b1", "ovs_interfaceid": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:07:b0:59,bridge_name='br-int',has_traffic_filtering=True,id=19fab0cc-b1c5-471b-8fae-30eec3d6659c,network=Network(a8f622c2-5f60-4987-ad67-fe6d77ba5a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19fab0cc-b1') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG os_vif [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:b0:59,bridge_name='br-int',has_traffic_filtering=True,id=19fab0cc-b1c5-471b-8fae-30eec3d6659c,network=Network(a8f622c2-5f60-4987-ad67-fe6d77ba5a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19fab0cc-b1') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2a48cc58-878a-551f-b8fd-e9dc44ec88f1', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap19fab0cc-b1, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap19fab0cc-b1, col_values=(('qos', UUID('0423cbf2-329e-40fc-b460-e68fe84dceb0')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap19fab0cc-b1, col_values=(('external_ids', {'iface-id': '19fab0cc-b1c5-471b-8fae-30eec3d6659c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:07:b0:59', 'vm-uuid': 'cd751613-c043-4903-b45c-1f19dccb0acb'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:23 user nova-compute[74646]: INFO os_vif [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:07:b0:59,bridge_name='br-int',has_traffic_filtering=True,id=19fab0cc-b1c5-471b-8fae-30eec3d6659c,network=Network(a8f622c2-5f60-4987-ad67-fe6d77ba5a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19fab0cc-b1')
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] No VIF found with MAC fa:16:3e:07:b0:59, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-54c91663-da5b-4dd4-8270-c51330e29330 req-93f4732a-c559-4083-a45c-3702558d0de5 service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Received event network-vif-plugged-19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-54c91663-da5b-4dd4-8270-c51330e29330 req-93f4732a-c559-4083-a45c-3702558d0de5 service nova] Acquiring lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-54c91663-da5b-4dd4-8270-c51330e29330 req-93f4732a-c559-4083-a45c-3702558d0de5 service nova] Lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-54c91663-da5b-4dd4-8270-c51330e29330 req-93f4732a-c559-4083-a45c-3702558d0de5 service nova] Lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-54c91663-da5b-4dd4-8270-c51330e29330 req-93f4732a-c559-4083-a45c-3702558d0de5 service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] No waiting events found dispatching network-vif-plugged-19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:01:25 user nova-compute[74646]: WARNING nova.compute.manager [req-54c91663-da5b-4dd4-8270-c51330e29330 req-93f4732a-c559-4083-a45c-3702558d0de5 service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Received unexpected event network-vif-plugged-19fab0cc-b1c5-471b-8fae-30eec3d6659c for instance with vm_state building and task_state spawning.
Oct 26 16:01:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-aba308dd-ce86-42b0-89b9-d60f0f6a527f req-032450e4-ad0a-411d-b424-a021e0672134 service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Received event network-vif-plugged-19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aba308dd-ce86-42b0-89b9-d60f0f6a527f req-032450e4-ad0a-411d-b424-a021e0672134 service nova] Acquiring lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aba308dd-ce86-42b0-89b9-d60f0f6a527f req-032450e4-ad0a-411d-b424-a021e0672134 service nova] Lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aba308dd-ce86-42b0-89b9-d60f0f6a527f req-032450e4-ad0a-411d-b424-a021e0672134 service nova] Lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-aba308dd-ce86-42b0-89b9-d60f0f6a527f req-032450e4-ad0a-411d-b424-a021e0672134 service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] No waiting events found dispatching network-vif-plugged-19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:01:27 user nova-compute[74646]: WARNING nova.compute.manager [req-aba308dd-ce86-42b0-89b9-d60f0f6a527f req-032450e4-ad0a-411d-b424-a021e0672134 service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Received unexpected event network-vif-plugged-19fab0cc-b1c5-471b-8fae-30eec3d6659c for instance with vm_state building and task_state spawning.
Oct 26 16:01:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:01:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:01:27 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:01:27 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:01:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7678MB free_disk=25.368186950683594GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:01:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:27 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Instance spawned successfully.
Oct 26 16:01:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Applying migration context for instance 96a71d00-27f0-4dbe-88cb-e6f296178e90 as it has an incoming, in-progress migration d8bca77f-f719-4aee-9148-1fcb26e28bc8. Migration status is finished {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 16:01:28 user nova-compute[74646]: INFO nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating resource usage from migration d8bca77f-f719-4aee-9148-1fcb26e28bc8
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:01:28 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Creating image(s)
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "/opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "/opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "/opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:28 user nova-compute[74646]: INFO nova.compute.manager [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Took 6.75 seconds to spawn the instance on the hypervisor.
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2b514455-44b2-4115-bb13-38ba1713a263 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 51088a91-dc4a-467c-8f35-3c85a9ddd3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Migration d8bca77f-f719-4aee-9148-1fcb26e28bc8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 96a71d00-27f0-4dbe-88cb-e6f296178e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 696aeb6d-33b0-4fd5-9b03-91375b0c30dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance cd751613-c043-4903-b45c-1f19dccb0acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG os_brick.utils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d819db9-5788-40ff-9919-dee575215f95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8450e3-ba80-481d-bb81-acc5c5c27588]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f918027f-c10a-4510-b41c-540bb94b92ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69bcf96-8831-4c65-9319-3f3a8ca7b0f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.233s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:28 user nova-compute[74646]: INFO nova.compute.manager [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Took 7.79 seconds to build instance.
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:01:28 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1315a511-bcd7-437f-bc4b-194b1b261afd]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a63b28b4-c192-4548-a4f9-25fe912ecab4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "cd751613-c043-4903-b45c-1f19dccb0acb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.954s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG os_brick.utils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] <== get_connector_properties: return (228ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Updating existing volume attachment record: cf291692-1c4c-430e-b864-52670788654a {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.213s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk 1073741824" returned: 0 in 0.065s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.179s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:01:28 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.049s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Cannot resize image /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Ensure instance console log exists: /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Start _get_guest_xml network_info=[{"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '99376b57-ac3f-493d-a626-9614a089c399', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTufjnmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b79f5ea4-ea88-41b4-8ca2-116b5b6408de', 'attached_at': '', 'detached_at': '', 'volume_id': 'f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a', 'serial': 'f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:01:29 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 16:01:29 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.objects.instance [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lazy-loading 'vcpu_model' on Instance uuid b79f5ea4-ea88-41b4-8ca2-116b5b6408de {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTufjnmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:01:29 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:01:29 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:01:29 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d5e319d-4a82-42d1-ab0a-e436b59b992b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:01:29 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01dc05a-737a-477b-b622-5c1e15b59264]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a] added
Oct 26 16:01:29 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca57f81-9921-4abb-aba9-914df49443d4]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e696ee-f7b1-40f8-99fd-f071ceee5dc7]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTufjnmw {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lTufjnmw" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac2c648-58e8-4783-9161-d05fc131b5ce]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lTufjnmw'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98412c2-9a32-42ef-8a38-d30e4689d811]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c58df7-4e38-4a2a-af80-347f2619cb0b]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:01:29 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:01:29 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41ec9bd-8426-4665-b3fe-b360da7aa581]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260]
Oct 26 16:01:29 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260] successful.
Oct 26 16:01:29 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74874f8-63f0-4d24-88e4-c1220a8afe5e]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc2d3a8-64fc-4ad7-b9c4-8ca5bc703560]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:01:29 user nova-compute[74646]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:01:29 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:01:29 user nova-compute[74646]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:01:29 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] HCTL ('33', '-', '-', 0) found on session 24 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[df906f15-cf36-4e38-857c-773c1294073b]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Searching for a device in session 24 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:01:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTufjnmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Didn't find any instances for network info cache update. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23630363363623232', 'path': '/dev/sdb'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630363363623232', 'path': '/dev/sdb'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-587138455',display_name='tempest-ServerActionsTestOtherA-server-1879145648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-587138455',id=20,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbmmCHSiAv6wnl4y6udIFIXZEW/bOp74proj1U5AEM0+QPtfownIPyTApMq9brABhT3IwnIfBs9QKjt04IQsymoSPOFRANJzeHzmMShY1+CCmigklKl+J5T9ZIigvKl+w==',key_name='tempest-keypair-1281352566',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:58:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-y115hib0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=b79f5ea4-ea88-41b4-8ca2-116b5b6408de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=c3fa2d89-235f-4939-8eff-e59c02c578fe,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fa2d89-23') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:01:30 user nova-compute[74646]:   <uuid>b79f5ea4-ea88-41b4-8ca2-116b5b6408de</uuid>
Oct 26 16:01:30 user nova-compute[74646]:   <name>instance-00000014</name>
Oct 26 16:01:30 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:01:30 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:01:30 user nova-compute[74646]:   <metadata>
Oct 26 16:01:30 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:01:30 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:01:30 user nova-compute[74646]:       <nova:name>tempest-ServerActionsTestOtherA-server-1879145648</nova:name>
Oct 26 16:01:30 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:01:29</nova:creationTime>
Oct 26 16:01:30 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:01:30 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:01:30 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:01:30 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:01:30 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:01:30 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:01:30 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:01:30 user nova-compute[74646]:       <nova:owner>
Oct 26 16:01:30 user nova-compute[74646]:         <nova:user uuid="9311cee7c04e45ddbae6f16ba43eed2e">tempest-ServerActionsTestOtherA-333958340-project-member</nova:user>
Oct 26 16:01:30 user nova-compute[74646]:         <nova:project uuid="6c8788e95cc244f98b0ff8d593d1e067">tempest-ServerActionsTestOtherA-333958340</nova:project>
Oct 26 16:01:30 user nova-compute[74646]:       </nova:owner>
Oct 26 16:01:30 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:01:30 user nova-compute[74646]:       <nova:ports>
Oct 26 16:01:30 user nova-compute[74646]:         <nova:port uuid="c3fa2d89-235f-4939-8eff-e59c02c578fe">
Oct 26 16:01:30 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 16:01:30 user nova-compute[74646]:         </nova:port>
Oct 26 16:01:30 user nova-compute[74646]:       </nova:ports>
Oct 26 16:01:30 user nova-compute[74646]:     </nova:instance>
Oct 26 16:01:30 user nova-compute[74646]:   </metadata>
Oct 26 16:01:30 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:01:30 user nova-compute[74646]:     <system>
Oct 26 16:01:30 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:01:30 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:01:30 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:01:30 user nova-compute[74646]:       <entry name="serial">b79f5ea4-ea88-41b4-8ca2-116b5b6408de</entry>
Oct 26 16:01:30 user nova-compute[74646]:       <entry name="uuid">b79f5ea4-ea88-41b4-8ca2-116b5b6408de</entry>
Oct 26 16:01:30 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:01:30 user nova-compute[74646]:     </system>
Oct 26 16:01:30 user nova-compute[74646]:   </sysinfo>
Oct 26 16:01:30 user nova-compute[74646]:   <os>
Oct 26 16:01:30 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:01:30 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:01:30 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:01:30 user nova-compute[74646]:   </os>
Oct 26 16:01:30 user nova-compute[74646]:   <features>
Oct 26 16:01:30 user nova-compute[74646]:     <acpi/>
Oct 26 16:01:30 user nova-compute[74646]:     <apic/>
Oct 26 16:01:30 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:01:30 user nova-compute[74646]:   </features>
Oct 26 16:01:30 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:01:30 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:01:30 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:01:30 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:01:30 user nova-compute[74646]:   </clock>
Oct 26 16:01:30 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:01:30 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:01:30 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:01:30 user nova-compute[74646]:   </cpu>
Oct 26 16:01:30 user nova-compute[74646]:   <devices>
Oct 26 16:01:30 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:01:30 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:01:30 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk"/>
Oct 26 16:01:30 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:01:30 user nova-compute[74646]:     </disk>
Oct 26 16:01:30 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:01:30 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:01:30 user nova-compute[74646]:       <source dev="/dev/sdb"/>
Oct 26 16:01:30 user nova-compute[74646]:       <target dev="vdb" bus="virtio"/>
Oct 26 16:01:30 user nova-compute[74646]:       <serial>f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a</serial>
Oct 26 16:01:30 user nova-compute[74646]:     </disk>
Oct 26 16:01:30 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:01:30 user nova-compute[74646]:       <mac address="fa:16:3e:60:7f:15"/>
Oct 26 16:01:30 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:01:30 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:01:30 user nova-compute[74646]:       <target dev="tapc3fa2d89-23"/>
Oct 26 16:01:30 user nova-compute[74646]:     </interface>
Oct 26 16:01:30 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:01:30 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/console.log" append="off"/>
Oct 26 16:01:30 user nova-compute[74646]:     </serial>
Oct 26 16:01:30 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:01:30 user nova-compute[74646]:     <video>
Oct 26 16:01:30 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:01:30 user nova-compute[74646]:     </video>
Oct 26 16:01:30 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:01:30 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:01:30 user nova-compute[74646]:     </rng>
Oct 26 16:01:30 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:01:30 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:01:30 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:01:30 user nova-compute[74646]:     </memballoon>
Oct 26 16:01:30 user nova-compute[74646]:   </devices>
Oct 26 16:01:30 user nova-compute[74646]: </domain>
Oct 26 16:01:30 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-587138455',display_name='tempest-ServerActionsTestOtherA-server-1879145648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-587138455',id=20,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbmmCHSiAv6wnl4y6udIFIXZEW/bOp74proj1U5AEM0+QPtfownIPyTApMq9brABhT3IwnIfBs9QKjt04IQsymoSPOFRANJzeHzmMShY1+CCmigklKl+J5T9ZIigvKl+w==',key_name='tempest-keypair-1281352566',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:58:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-y115hib0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:00:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=b79f5ea4-ea88-41b4-8ca2-116b5b6408de,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=c3fa2d89-235f-4939-8eff-e59c02c578fe,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fa2d89-23') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG os_vif [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=c3fa2d89-235f-4939-8eff-e59c02c578fe,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fa2d89-23') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0eafaa62-2c51-55df-ba0e-16d9466fafa5', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc3fa2d89-23, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc3fa2d89-23, col_values=(('qos', UUID('d42c3a85-2fdc-46b0-9f4a-e251aa0535c1')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc3fa2d89-23, col_values=(('external_ids', {'iface-id': 'c3fa2d89-235f-4939-8eff-e59c02c578fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:60:7f:15', 'vm-uuid': 'b79f5ea4-ea88-41b4-8ca2-116b5b6408de'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:30 user nova-compute[74646]: INFO os_vif [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=c3fa2d89-235f-4939-8eff-e59c02c578fe,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fa2d89-23')
Oct 26 16:01:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] No VIF found with MAC fa:16:3e:60:7f:15, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:01:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:32 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:01:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-7385426b-84c9-4a09-94aa-4df730a29ec0 req-5f1b804f-43d6-47c9-8909-e857496cfabc service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received event network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7385426b-84c9-4a09-94aa-4df730a29ec0 req-5f1b804f-43d6-47c9-8909-e857496cfabc service nova] Acquiring lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7385426b-84c9-4a09-94aa-4df730a29ec0 req-5f1b804f-43d6-47c9-8909-e857496cfabc service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7385426b-84c9-4a09-94aa-4df730a29ec0 req-5f1b804f-43d6-47c9-8909-e857496cfabc service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-7385426b-84c9-4a09-94aa-4df730a29ec0 req-5f1b804f-43d6-47c9-8909-e857496cfabc service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] No waiting events found dispatching network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:01:32 user nova-compute[74646]: WARNING nova.compute.manager [req-7385426b-84c9-4a09-94aa-4df730a29ec0 req-5f1b804f-43d6-47c9-8909-e857496cfabc service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received unexpected event network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe for instance with vm_state active and task_state rebuild_spawning.
Oct 26 16:01:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG nova.compute.manager [req-608996df-43dd-4099-b4e4-61bc93f6ca1f req-00c9993b-b1d0-446e-99cd-bc0d292cca78 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received event network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-608996df-43dd-4099-b4e4-61bc93f6ca1f req-00c9993b-b1d0-446e-99cd-bc0d292cca78 service nova] Acquiring lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-608996df-43dd-4099-b4e4-61bc93f6ca1f req-00c9993b-b1d0-446e-99cd-bc0d292cca78 service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-608996df-43dd-4099-b4e4-61bc93f6ca1f req-00c9993b-b1d0-446e-99cd-bc0d292cca78 service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG nova.compute.manager [req-608996df-43dd-4099-b4e4-61bc93f6ca1f req-00c9993b-b1d0-446e-99cd-bc0d292cca78 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] No waiting events found dispatching network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:01:34 user nova-compute[74646]: WARNING nova.compute.manager [req-608996df-43dd-4099-b4e4-61bc93f6ca1f req-00c9993b-b1d0-446e-99cd-bc0d292cca78 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received unexpected event network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe for instance with vm_state active and task_state rebuild_spawning.
Oct 26 16:01:34 user nova-compute[74646]: DEBUG nova.compute.manager [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:01:34 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Instance spawned successfully.
Oct 26 16:01:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG nova.compute.manager [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG nova.objects.instance [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74646) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 26 16:01:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aefa9e8e-9a81-445e-b5ad-616af45914e4 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.095s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "2b514455-44b2-4115-bb13-38ba1713a263" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "2b514455-44b2-4115-bb13-38ba1713a263" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "2b514455-44b2-4115-bb13-38ba1713a263-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "2b514455-44b2-4115-bb13-38ba1713a263-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "2b514455-44b2-4115-bb13-38ba1713a263-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:36 user nova-compute[74646]: INFO nova.compute.manager [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Terminating instance
Oct 26 16:01:36 user nova-compute[74646]: DEBUG nova.compute.manager [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-a7a7622a-c082-4bf5-a26c-e0599422219b req-42d34af0-812a-454c-988b-13d2af2fdc71 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Received event network-vif-unplugged-db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a7a7622a-c082-4bf5-a26c-e0599422219b req-42d34af0-812a-454c-988b-13d2af2fdc71 service nova] Acquiring lock "2b514455-44b2-4115-bb13-38ba1713a263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a7a7622a-c082-4bf5-a26c-e0599422219b req-42d34af0-812a-454c-988b-13d2af2fdc71 service nova] Lock "2b514455-44b2-4115-bb13-38ba1713a263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a7a7622a-c082-4bf5-a26c-e0599422219b req-42d34af0-812a-454c-988b-13d2af2fdc71 service nova] Lock "2b514455-44b2-4115-bb13-38ba1713a263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-a7a7622a-c082-4bf5-a26c-e0599422219b req-42d34af0-812a-454c-988b-13d2af2fdc71 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] No waiting events found dispatching network-vif-unplugged-db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-a7a7622a-c082-4bf5-a26c-e0599422219b req-42d34af0-812a-454c-988b-13d2af2fdc71 service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Received event network-vif-unplugged-db3b9afe-9410-40a7-981e-cb59201a81b2 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:01:37 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Instance destroyed successfully.
Oct 26 16:01:37 user nova-compute[74646]: DEBUG nova.objects.instance [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lazy-loading 'resources' on Instance uuid 2b514455-44b2-4115-bb13-38ba1713a263 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:55:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1989406713',display_name='tempest-VolumesAdminNegativeTest-server-1989406713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1989406713',id=15,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFht9hnSgYylRDeMSywvMgAV5i27sF0PdpixMYVqQGizFbY0kIUpKCBfVJ/RzOpqltF8r/N/DHFo5YIJuQbdba2FOqVCOmOpuWK6Jv0wQeYDYLNe2LRP4KatXjPPHbOM8A==',key_name='tempest-keypair-2021206852',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:55:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e1515df0bbff42d5be9f8ba40cdeb0da',ramdisk_id='',reservation_id='r-k0iykmln',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-464290099',owner_user_name='tempest-VolumesAdminNegativeTest-464290099-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:55:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='05a35d09461745e1a1250ecdc2443a75',uuid=2b514455-44b2-4115-bb13-38ba1713a263,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db3b9afe-9410-40a7-981e-cb59201a81b2", "address": "fa:16:3e:4a:fd:67", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3b9afe-94", "ovs_interfaceid": "db3b9afe-9410-40a7-981e-cb59201a81b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Converting VIF {"id": "db3b9afe-9410-40a7-981e-cb59201a81b2", "address": "fa:16:3e:4a:fd:67", "network": {"id": "a23d40dd-77c0-4375-b256-1c5a6caa93ba", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-482908181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e1515df0bbff42d5be9f8ba40cdeb0da", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb3b9afe-94", "ovs_interfaceid": "db3b9afe-9410-40a7-981e-cb59201a81b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:fd:67,bridge_name='br-int',has_traffic_filtering=True,id=db3b9afe-9410-40a7-981e-cb59201a81b2,network=Network(a23d40dd-77c0-4375-b256-1c5a6caa93ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb3b9afe-94') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG os_vif [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:fd:67,bridge_name='br-int',has_traffic_filtering=True,id=db3b9afe-9410-40a7-981e-cb59201a81b2,network=Network(a23d40dd-77c0-4375-b256-1c5a6caa93ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb3b9afe-94') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb3b9afe-94, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ba7cad59-833c-48ef-b146-e0148485a302) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:37 user nova-compute[74646]: INFO os_vif [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:fd:67,bridge_name='br-int',has_traffic_filtering=True,id=db3b9afe-9410-40a7-981e-cb59201a81b2,network=Network(a23d40dd-77c0-4375-b256-1c5a6caa93ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb3b9afe-94')
Oct 26 16:01:37 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Deleting instance files /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263_del
Oct 26 16:01:37 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Deletion of /opt/stack/data/nova/instances/2b514455-44b2-4115-bb13-38ba1713a263_del complete
Oct 26 16:01:37 user nova-compute[74646]: INFO nova.compute.manager [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Took 0.99 seconds to destroy the instance on the hypervisor.
Oct 26 16:01:37 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:01:37 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:01:38 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:01:38 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Took 0.94 seconds to deallocate network for instance.
Oct 26 16:01:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-2e3d01bf-733d-480b-b0fa-7c403c7bf87a req-8b3157bb-a700-4942-b0b4-47cd9273316d service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Received event network-vif-plugged-db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2e3d01bf-733d-480b-b0fa-7c403c7bf87a req-8b3157bb-a700-4942-b0b4-47cd9273316d service nova] Acquiring lock "2b514455-44b2-4115-bb13-38ba1713a263-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2e3d01bf-733d-480b-b0fa-7c403c7bf87a req-8b3157bb-a700-4942-b0b4-47cd9273316d service nova] Lock "2b514455-44b2-4115-bb13-38ba1713a263-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2e3d01bf-733d-480b-b0fa-7c403c7bf87a req-8b3157bb-a700-4942-b0b4-47cd9273316d service nova] Lock "2b514455-44b2-4115-bb13-38ba1713a263-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-2e3d01bf-733d-480b-b0fa-7c403c7bf87a req-8b3157bb-a700-4942-b0b4-47cd9273316d service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] No waiting events found dispatching network-vif-plugged-db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:01:39 user nova-compute[74646]: WARNING nova.compute.manager [req-2e3d01bf-733d-480b-b0fa-7c403c7bf87a req-8b3157bb-a700-4942-b0b4-47cd9273316d service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Received unexpected event network-vif-plugged-db3b9afe-9410-40a7-981e-cb59201a81b2 for instance with vm_state deleted and task_state None.
Oct 26 16:01:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-2e3d01bf-733d-480b-b0fa-7c403c7bf87a req-8b3157bb-a700-4942-b0b4-47cd9273316d service nova] [instance: 2b514455-44b2-4115-bb13-38ba1713a263] Received event network-vif-deleted-db3b9afe-9410-40a7-981e-cb59201a81b2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:39 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:01:39 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:01:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.559s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:39 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Deleted allocations for instance 2b514455-44b2-4115-bb13-38ba1713a263
Oct 26 16:01:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7a88280a-c231-46ec-b47d-aa47a56b1106 tempest-VolumesAdminNegativeTest-464290099 tempest-VolumesAdminNegativeTest-464290099-project-member] Lock "2b514455-44b2-4115-bb13-38ba1713a263" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.761s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Port 3e16bb7b-c1c2-4a11-aad9-2da2fbae632b binding to destination host user is already ACTIVE {{(pid=74646) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 16:01:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:01:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquired lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:01:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:01:49 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating instance_info_cache with network_info: [{"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:01:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Releasing lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:01:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Creating tmpfile /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/tmp0f61das2 to verify with other compute node that the instance is on the same shared storage. {{(pid=74646) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 26 16:01:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-d06f151d-3233-420f-b6fb-443879b83b72 req-15b92880-9e40-45dc-8e0b-05383f43ce71 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-vif-unplugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d06f151d-3233-420f-b6fb-443879b83b72 req-15b92880-9e40-45dc-8e0b-05383f43ce71 service nova] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d06f151d-3233-420f-b6fb-443879b83b72 req-15b92880-9e40-45dc-8e0b-05383f43ce71 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d06f151d-3233-420f-b6fb-443879b83b72 req-15b92880-9e40-45dc-8e0b-05383f43ce71 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-d06f151d-3233-420f-b6fb-443879b83b72 req-15b92880-9e40-45dc-8e0b-05383f43ce71 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] No waiting events found dispatching network-vif-unplugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:01:50 user nova-compute[74646]: WARNING nova.compute.manager [req-d06f151d-3233-420f-b6fb-443879b83b72 req-15b92880-9e40-45dc-8e0b-05383f43ce71 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received unexpected event network-vif-unplugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b for instance with vm_state resized and task_state resize_reverting.
Oct 26 16:01:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Instance destroyed successfully.
Oct 26 16:01:50 user nova-compute[74646]: DEBUG nova.objects.instance [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lazy-loading 'resources' on Instance uuid 96a71d00-27f0-4dbe-88cb-e6f296178e90 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-577894992',display_name='tempest-ServerActionsTestOtherB-server-577894992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-577894992',id=16,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8WuJBWWQ3dPKpsfd3pTt9BdyjBEif+cyL8w8Tg3VzJlkHtDxzbffk6KqqzEPT5s/X3OVnkganTQcqlWVpiRN+miRvt4exLQM5oDzUYlmj5/y40opmavHEPxTdEvfSLNw==',key_name='tempest-keypair-721457332',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:00:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c99559f6003420bb1014bdb0f0988ff',ramdisk_id='',reservation_id='r-4yydauu2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1825400277',owner_user_name='tempest-ServerActionsTestOtherB-1825400277-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86031b2e164644e0a59efcd110ddf497',uuid=96a71d00-27f0-4dbe-88cb-e6f296178e90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converting VIF {"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_vif [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e16bb7b-c1, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8eb542fa-0e37-40e8-8165-5aa3726af28f) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:50 user nova-compute[74646]: INFO os_vif [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1')
Oct 26 16:01:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIAGxZjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:01:50 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbe9912-7799-4436-8a2a-12f317c6fee7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:01:50 user nova-compute[74646]: No targets found.
Oct 26 16:01:50 user nova-compute[74646]: iSNS:
Oct 26 16:01:50 user nova-compute[74646]: No targets found.
Oct 26 16:01:50 user nova-compute[74646]: STATIC:
Oct 26 16:01:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a
Oct 26 16:01:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:01:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:01:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509
Oct 26 16:01:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:01:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:01:50 user nova-compute[74646]: FIRMWARE:
Oct 26 16:01:50 user nova-compute[74646]: No targets found.
Oct 26 16:01:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:01:50 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:01:50 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0533af1-eb82-4eab-a385-68d32f0279ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[914bfb0a-e6d1-422d-afe1-450cd48fd563]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:01:50 user nova-compute[74646]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:01:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:01:50 user nova-compute[74646]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:01:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e01cd750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509'): ({'sdd'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Removing single pathed devices sdd {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84e6d95-c573-4ac9-aec5-cbcc23bef5c4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eefa5c55-3a7a-49c6-8677-a75f639b40f0]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Flushing IO for device /dev/sdd {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[356b5d33-6d86-4dc3-9e85-85c82d1d2910]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cacf2eb-04c1-4323-854f-8a2934589c57]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[993b97fc-56ec-4c10-93a6-09afaad55ba8]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41e71bb-6c63-4a87-8242-27d0c3bd28e2]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260]
Oct 26 16:01:50 user nova-compute[74646]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260] successful.
Oct 26 16:01:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7f3327-58f7-41b2-a876-f6d4b7a683b9]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] <== disconnect_volume: return (397ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:01:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:01:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-a8f0a00f-7d0e-40df-afc1-7fba874c588b req-70d8c113-a694-46ef-b615-69ac3d91c7a0 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a8f0a00f-7d0e-40df-afc1-7fba874c588b req-70d8c113-a694-46ef-b615-69ac3d91c7a0 service nova] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a8f0a00f-7d0e-40df-afc1-7fba874c588b req-70d8c113-a694-46ef-b615-69ac3d91c7a0 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a8f0a00f-7d0e-40df-afc1-7fba874c588b req-70d8c113-a694-46ef-b615-69ac3d91c7a0 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-a8f0a00f-7d0e-40df-afc1-7fba874c588b req-70d8c113-a694-46ef-b615-69ac3d91c7a0 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] No waiting events found dispatching network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:01:52 user nova-compute[74646]: WARNING nova.compute.manager [req-a8f0a00f-7d0e-40df-afc1-7fba874c588b req-70d8c113-a694-46ef-b615-69ac3d91c7a0 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received unexpected event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b for instance with vm_state resized and task_state resize_reverting.
Oct 26 16:01:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:52 user nova-compute[74646]: DEBUG nova.objects.instance [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lazy-loading 'migration_context' on Instance uuid 96a71d00-27f0-4dbe-88cb-e6f296178e90 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:01:52 user nova-compute[74646]: DEBUG nova.objects.base [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Object Instance<96a71d00-27f0-4dbe-88cb-e6f296178e90> lazy-loaded attributes: resources,migration_context {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:01:52 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:01:52 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:01:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.545s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:53 user nova-compute[74646]: INFO nova.compute.manager [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Swapping old allocation on dict_keys(['88f94598-b16e-4979-b37d-cf11430ad3e6']) held by migration d8bca77f-f719-4aee-9148-1fcb26e28bc8 for instance
Oct 26 16:01:53 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Overwriting current allocation {'allocations': {'88f94598-b16e-4979-b37d-cf11430ad3e6': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 30}}, 'project_id': '5c99559f6003420bb1014bdb0f0988ff', 'user_id': '86031b2e164644e0a59efcd110ddf497', 'consumer_generation': 1} on consumer 96a71d00-27f0-4dbe-88cb-e6f296178e90 {{(pid=74646) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquired lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating instance_info_cache with network_info: [{"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Releasing lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG os_brick.utils [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b635802-651a-4a32-b78f-577f9d336f74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8991c8cd-2087-42bd-b64b-c2c0a4839be0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e17b3d-575d-4250-8f75-9f0f2f09ea70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[263a9a2e-796a-4ae8-95a8-46ba3924b7e8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:01:53 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:01:53 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ec0d80-9cc2-42b0-9c36-c8cd38919914]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:01:53 user nova-compute[74646]: DEBUG os_brick.utils [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:01:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-c6375914-d910-4194-bca6-759fc424dac4 req-9972ba26-98f0-4ff6-b425-191cce939270 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received event network-changed-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:01:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-c6375914-d910-4194-bca6-759fc424dac4 req-9972ba26-98f0-4ff6-b425-191cce939270 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Refreshing instance network info cache due to event network-changed-645c2ddb-c31c-454f-8f2f-615bec1fef32. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:01:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c6375914-d910-4194-bca6-759fc424dac4 req-9972ba26-98f0-4ff6-b425-191cce939270 service nova] Acquiring lock "refresh_cache-2bae2991-6c17-4d79-9dd8-1fc69322f830" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:01:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c6375914-d910-4194-bca6-759fc424dac4 req-9972ba26-98f0-4ff6-b425-191cce939270 service nova] Acquired lock "refresh_cache-2bae2991-6c17-4d79-9dd8-1fc69322f830" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:01:55 user nova-compute[74646]: DEBUG nova.network.neutron [req-c6375914-d910-4194-bca6-759fc424dac4 req-9972ba26-98f0-4ff6-b425-191cce939270 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Refreshing network info cache for port 645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:01:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:55 user nova-compute[74646]: DEBUG nova.network.neutron [req-c6375914-d910-4194-bca6-759fc424dac4 req-9972ba26-98f0-4ff6-b425-191cce939270 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Updated VIF entry in instance network info cache for port 645c2ddb-c31c-454f-8f2f-615bec1fef32. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:01:55 user nova-compute[74646]: DEBUG nova.network.neutron [req-c6375914-d910-4194-bca6-759fc424dac4 req-9972ba26-98f0-4ff6-b425-191cce939270 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Updating instance_info_cache with network_info: [{"id": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "address": "fa:16:3e:6e:7d:58", "network": {"id": "af5d1879-5cbd-45d2-97c0-e6cc4ac39d01", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-49924591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72016ef51af8410c88eb0deb826ae3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645c2ddb-c3", "ovs_interfaceid": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:01:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c6375914-d910-4194-bca6-759fc424dac4 req-9972ba26-98f0-4ff6-b425-191cce939270 service nova] Releasing lock "refresh_cache-2bae2991-6c17-4d79-9dd8-1fc69322f830" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:01:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG nova.objects.instance [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lazy-loading 'flavor' on Instance uuid 2bae2991-6c17-4d79-9dd8-1fc69322f830 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:01:56 user nova-compute[74646]: INFO nova.compute.manager [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Attaching volume f04279dd-58aa-4c4c-a66c-2b2169de4886 to /dev/vdb
Oct 26 16:01:56 user nova-compute[74646]: DEBUG os_brick.utils [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1a41f7-29c6-4b41-bde6-a32ae218b658]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b999671e-bf72-4b40-9038-916f9e452ad0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cae616-4374-499e-a9e0-1f7a30ba7e04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[441cf8f6-a803-4be7-8b81-da440a6fa426]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:01:56 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:01:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[695edb2d-a00a-4ee2-8954-c33116b51b4b]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG os_brick.utils [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:01:56 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Updating existing volume attachment record: 5fc007d9-ddf3-4c18-bf35-4b96905577e4 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:02:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Starting finish_revert_migration {{(pid=74646) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Start _get_guest_xml network_info=[{"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '1df28e26-dee5-4656-a4e4-5fe5c3a9fb68', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIAGxZjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '96a71d00-27f0-4dbe-88cb-e6f296178e90', 'attached_at': '2023-10-26T16:02:12.000000', 'detached_at': '', 'volume_id': 'f149e265-10cd-4341-9baf-859d99ae7509', 'serial': 'f149e265-10cd-4341-9baf-859d99ae7509'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:02:12 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:02:12 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.objects.instance [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lazy-loading 'vcpu_model' on Instance uuid 96a71d00-27f0-4dbe-88cb-e6f296178e90 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIAGxZjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:02:12 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:02:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:02:12 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:02:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:02:12 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[047bac63-461f-4210-ad9d-2d19742ee334]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:02:12 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad16dda-cbc8-4509-8ec5-0bb9f21792fe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509] added
Oct 26 16:02:12 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8344d28c-3d94-4d53-9e2c-bd29842bccde]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a51b1b-c6f1-4f7d-a1ce-6616b7a5c437]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIAGxZjY {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zIAGxZjY" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[130f1e77-ce3e-4343-981e-7f8ab4eec1b2]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zIAGxZjY'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f04605-021d-4ef6-99f8-e4d45cc4a6be]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[034851a8-e6c2-49d0-8192-44c76042e4b3]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:12 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:12 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:02:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e68b6e-0c2d-47ea-9152-e2dea8c24495]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260]
Oct 26 16:02:13 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260] successful.
Oct 26 16:02:13 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95f8342-fbc2-4dc9-bbf4-38c2f466655a]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c282b0eb-a82e-4702-9ee7-8d27745e893c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:13 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:13 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:13 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:13 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[145a5019-b467-4517-ab01-dfa5595533b9]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIAGxZjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG nova.objects.instance [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lazy-loading 'flavor' on Instance uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:13 user nova-compute[74646]: INFO nova.compute.manager [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Attaching volume c483fded-56d0-446f-a734-29f49627d0cd to /dev/vdb
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.utils [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11e7bc6-8425-49bf-977a-9fcb2595719f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[74282b15-dcef-429f-a992-c69b38118415]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e003a9-359a-4dd1-9237-7658878a0a91]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcbedebc-c95a-4eb1-b304-be8d8e44ab54]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:02:13 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:02:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2ab3fd-ade3-42db-9cca-d174caa62cb0]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG os_brick.utils [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:02:13 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Updating existing volume attachment record: f8fda8b2-e801-45a7-a8fb-4ff6b0f4102d {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.286s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '23866366261613861', 'path': '/dev/sdc'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23866366261613861', 'path': '/dev/sdc'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-577894992',display_name='tempest-ServerActionsTestOtherB-server-577894992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-577894992',id=16,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8WuJBWWQ3dPKpsfd3pTt9BdyjBEif+cyL8w8Tg3VzJlkHtDxzbffk6KqqzEPT5s/X3OVnkganTQcqlWVpiRN+miRvt4exLQM5oDzUYlmj5/y40opmavHEPxTdEvfSLNw==',key_name='tempest-keypair-721457332',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:00:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5c99559f6003420bb1014bdb0f0988ff',ramdisk_id='',reservation_id='r-4yydauu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1825400277',owner_user_name='tempest-ServerActionsTestOtherB-1825400277-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86031b2e164644e0a59efcd110ddf497',uuid=96a71d00-27f0-4dbe-88cb-e6f296178e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converting VIF {"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:02:14 user nova-compute[74646]:   <uuid>96a71d00-27f0-4dbe-88cb-e6f296178e90</uuid>
Oct 26 16:02:14 user nova-compute[74646]:   <name>instance-00000010</name>
Oct 26 16:02:14 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:02:14 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:02:14 user nova-compute[74646]:   <metadata>
Oct 26 16:02:14 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:02:14 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:02:14 user nova-compute[74646]:       <nova:name>tempest-ServerActionsTestOtherB-server-577894992</nova:name>
Oct 26 16:02:14 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:02:12</nova:creationTime>
Oct 26 16:02:14 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:02:14 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:02:14 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:02:14 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:02:14 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:02:14 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:02:14 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:02:14 user nova-compute[74646]:       <nova:owner>
Oct 26 16:02:14 user nova-compute[74646]:         <nova:user uuid="86031b2e164644e0a59efcd110ddf497">tempest-ServerActionsTestOtherB-1825400277-project-member</nova:user>
Oct 26 16:02:14 user nova-compute[74646]:         <nova:project uuid="5c99559f6003420bb1014bdb0f0988ff">tempest-ServerActionsTestOtherB-1825400277</nova:project>
Oct 26 16:02:14 user nova-compute[74646]:       </nova:owner>
Oct 26 16:02:14 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:02:14 user nova-compute[74646]:       <nova:ports>
Oct 26 16:02:14 user nova-compute[74646]:         <nova:port uuid="3e16bb7b-c1c2-4a11-aad9-2da2fbae632b">
Oct 26 16:02:14 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 16:02:14 user nova-compute[74646]:         </nova:port>
Oct 26 16:02:14 user nova-compute[74646]:       </nova:ports>
Oct 26 16:02:14 user nova-compute[74646]:     </nova:instance>
Oct 26 16:02:14 user nova-compute[74646]:   </metadata>
Oct 26 16:02:14 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:02:14 user nova-compute[74646]:     <system>
Oct 26 16:02:14 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:02:14 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:02:14 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:02:14 user nova-compute[74646]:       <entry name="serial">96a71d00-27f0-4dbe-88cb-e6f296178e90</entry>
Oct 26 16:02:14 user nova-compute[74646]:       <entry name="uuid">96a71d00-27f0-4dbe-88cb-e6f296178e90</entry>
Oct 26 16:02:14 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:02:14 user nova-compute[74646]:     </system>
Oct 26 16:02:14 user nova-compute[74646]:   </sysinfo>
Oct 26 16:02:14 user nova-compute[74646]:   <os>
Oct 26 16:02:14 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:02:14 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:02:14 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:02:14 user nova-compute[74646]:   </os>
Oct 26 16:02:14 user nova-compute[74646]:   <features>
Oct 26 16:02:14 user nova-compute[74646]:     <acpi/>
Oct 26 16:02:14 user nova-compute[74646]:     <apic/>
Oct 26 16:02:14 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:02:14 user nova-compute[74646]:   </features>
Oct 26 16:02:14 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:02:14 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:02:14 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:02:14 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:02:14 user nova-compute[74646]:   </clock>
Oct 26 16:02:14 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:02:14 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:02:14 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:02:14 user nova-compute[74646]:   </cpu>
Oct 26 16:02:14 user nova-compute[74646]:   <devices>
Oct 26 16:02:14 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:02:14 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:02:14 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk"/>
Oct 26 16:02:14 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:02:14 user nova-compute[74646]:     </disk>
Oct 26 16:02:14 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:02:14 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:02:14 user nova-compute[74646]:       <source dev="/dev/sdc"/>
Oct 26 16:02:14 user nova-compute[74646]:       <target dev="vdb" bus="virtio"/>
Oct 26 16:02:14 user nova-compute[74646]:       <serial>f149e265-10cd-4341-9baf-859d99ae7509</serial>
Oct 26 16:02:14 user nova-compute[74646]:     </disk>
Oct 26 16:02:14 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:02:14 user nova-compute[74646]:       <mac address="fa:16:3e:7e:a4:63"/>
Oct 26 16:02:14 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:02:14 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:02:14 user nova-compute[74646]:       <target dev="tap3e16bb7b-c1"/>
Oct 26 16:02:14 user nova-compute[74646]:     </interface>
Oct 26 16:02:14 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:02:14 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/console.log" append="off"/>
Oct 26 16:02:14 user nova-compute[74646]:     </serial>
Oct 26 16:02:14 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:02:14 user nova-compute[74646]:     <video>
Oct 26 16:02:14 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:02:14 user nova-compute[74646]:     </video>
Oct 26 16:02:14 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:02:14 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:02:14 user nova-compute[74646]:     </rng>
Oct 26 16:02:14 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:02:14 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:02:14 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:02:14 user nova-compute[74646]:     </memballoon>
Oct 26 16:02:14 user nova-compute[74646]:   </devices>
Oct 26 16:02:14 user nova-compute[74646]: </domain>
Oct 26 16:02:14 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-577894992',display_name='tempest-ServerActionsTestOtherB-server-577894992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-577894992',id=16,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8WuJBWWQ3dPKpsfd3pTt9BdyjBEif+cyL8w8Tg3VzJlkHtDxzbffk6KqqzEPT5s/X3OVnkganTQcqlWVpiRN+miRvt4exLQM5oDzUYlmj5/y40opmavHEPxTdEvfSLNw==',key_name='tempest-keypair-721457332',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:00:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5c99559f6003420bb1014bdb0f0988ff',ramdisk_id='',reservation_id='r-4yydauu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1825400277',owner_user_name='tempest-ServerActionsTestOtherB-1825400277-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:01:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86031b2e164644e0a59efcd110ddf497',uuid=96a71d00-27f0-4dbe-88cb-e6f296178e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converting VIF {"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG os_vif [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '05023755-74fa-5a87-9bba-64208721fb30', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e16bb7b-c1, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e16bb7b-c1, col_values=(('qos', UUID('4d8cbd1e-419f-4c48-acc6-d420944bef09')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e16bb7b-c1, col_values=(('external_ids', {'iface-id': '3e16bb7b-c1c2-4a11-aad9-2da2fbae632b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:a4:63', 'vm-uuid': '96a71d00-27f0-4dbe-88cb-e6f296178e90'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:02:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:14 user nova-compute[74646]: INFO os_vif [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1')
Oct 26 16:02:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-b45333f7-bdcd-4497-933b-61a7f5ce79a8 req-d1834dd5-e1a4-4d88-9684-44f8abec97c6 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:02:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b45333f7-bdcd-4497-933b-61a7f5ce79a8 req-d1834dd5-e1a4-4d88-9684-44f8abec97c6 service nova] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b45333f7-bdcd-4497-933b-61a7f5ce79a8 req-d1834dd5-e1a4-4d88-9684-44f8abec97c6 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b45333f7-bdcd-4497-933b-61a7f5ce79a8 req-d1834dd5-e1a4-4d88-9684-44f8abec97c6 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-b45333f7-bdcd-4497-933b-61a7f5ce79a8 req-d1834dd5-e1a4-4d88-9684-44f8abec97c6 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] No waiting events found dispatching network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:02:15 user nova-compute[74646]: WARNING nova.compute.manager [req-b45333f7-bdcd-4497-933b-61a7f5ce79a8 req-d1834dd5-e1a4-4d88-9684-44f8abec97c6 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received unexpected event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b for instance with vm_state resized and task_state resize_reverting.
Oct 26 16:02:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpUFDGbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:02:16 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:02:16 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:02:16 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a283d7f-f238-4a53-8882-a3ede4fb2077]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:02:16 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[581deea9-fcc0-4a4a-9694-3259a47503e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886] added
Oct 26 16:02:16 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19e1e31-a1a0-4829-9116-21fb90f10834]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93415e6-c076-4eff-a199-f65b4e4282e1]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cpUFDGbd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cpUFDGbd" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb329f2-b531-4824-ae8b-3b341b6f26c4]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cpUFDGbd'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c8d9f2-1e7b-4280-a0f8-124ea045fc46]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.compute.manager [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:02:16 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Creating image(s)
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Ensure instance console log exists: /opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Start _get_guest_xml network_info=[{"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'cf291692-1c4c-430e-b864-52670788654a', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLeTDFiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fa8813a4-be8c-452a-8d2d-a5fd972c2498', 'attached_at': '', 'detached_at': '', 'volume_id': '6e9aa5f9-c63b-4493-b887-bc5455f9dee2', 'serial': '6e9aa5f9-c63b-4493-b887-bc5455f9dee2'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[81094231-65e7-46fa-ab95-0411d430651a]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:16 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:16 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:16 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:16 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:16 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:02:16 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLeTDFiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:02:16 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cad0a45-2a07-4e00-99f5-b8f1188d12e6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886, portal: 172.16.0.220,3260]
Oct 26 16:02:16 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886, portal: 172.16.0.220,3260] successful.
Oct 26 16:02:16 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[180c1c02-f156-4f39-b514-57c153e2f2b5]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c6bfab-5d88-4216-97a0-9d4770aaf2c1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:16 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:16 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:16 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:16 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:16 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:16 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9583c9-dcae-4263-9ca0-2f9dac2d5166]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:16 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: None {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpUFDGbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23366336662663931', 'path': '/dev/sdd'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366336662663931', 'path': '/dev/sdd'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.106s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:02:17 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:02:17 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG nova.objects.instance [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lazy-loading 'flavor' on Instance uuid 2bae2991-6c17-4d79-9dd8-1fc69322f830 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4909139b-7e74-4867-9817-9664f2b7f30b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:02:17 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:02:17 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:02:17 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:02:17 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:02:17 user nova-compute[74646]:   <serial>f04279dd-58aa-4c4c-a66c-2b2169de4886</serial>
Oct 26 16:02:17 user nova-compute[74646]: </disk>
Oct 26 16:02:17 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f4f8be-572c-4dd0-8617-22cf3deb2b8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2] added
Oct 26 16:02:17 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1e7a2b-3c85-411c-a27a-47a4da167b3a]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab652f61-04df-49cb-a24a-ced88bd16aca]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLeTDFiQ {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLeTDFiQ" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a435113a-e9e1-48b9-9046-b91d3dfa66e5]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZLeTDFiQ'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a41a26bd-6dc5-4720-8d12-a76fb4c2fbbd]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[637090a9-6640-4987-abee-d7328293a3b1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:17 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:17 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:17 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:17 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:17 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:17 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-5ca502e4-1d83-496e-abab-d9a9e697d33c req-09578960-b9a7-4e40-a95c-9142e511da9c service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5ca502e4-1d83-496e-abab-d9a9e697d33c req-09578960-b9a7-4e40-a95c-9142e511da9c service nova] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5ca502e4-1d83-496e-abab-d9a9e697d33c req-09578960-b9a7-4e40-a95c-9142e511da9c service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5ca502e4-1d83-496e-abab-d9a9e697d33c req-09578960-b9a7-4e40-a95c-9142e511da9c service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-5ca502e4-1d83-496e-abab-d9a9e697d33c req-09578960-b9a7-4e40-a95c-9142e511da9c service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] No waiting events found dispatching network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:02:17 user nova-compute[74646]: WARNING nova.compute.manager [req-5ca502e4-1d83-496e-abab-d9a9e697d33c req-09578960-b9a7-4e40-a95c-9142e511da9c service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received unexpected event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b for instance with vm_state resized and task_state resize_reverting.
Oct 26 16:02:17 user nova-compute[74646]: DEBUG nova.compute.manager [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b582ec-4c5b-4f7a-b77c-6babcdba41df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2, portal: 172.16.0.220,3260]
Oct 26 16:02:17 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2, portal: 172.16.0.220,3260] successful.
Oct 26 16:02:17 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:17 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Instance running successfully.
Oct 26 16:02:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] finish_revert_migration finished successfully. {{(pid=74646) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8954f8b-628e-4c3a-9750-7ba7cdf8482b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e8b7cb-b8ba-4ec9-ab4d-6bdd978612dd]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:17 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:17 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:17 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:02:17 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:17 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:17 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:17 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:02:17 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae09d730-1868-4022-9f1e-b06aee482ece]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:02:17 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLeTDFiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:02:18 user nova-compute[74646]: INFO nova.compute.manager [None req-8bb34e09-debb-4711-a119-696d466817db tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating instance to original state: 'active'
Oct 26 16:02:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:02:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:02:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] No VIF found with MAC fa:16:3e:6e:7d:58, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:02:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2da4da49-9df6-4472-8be6-f01425effbd6 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.016s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] <== connect_volume: return (2495ms) {'type': 'block', 'scsi_wwn': '23033633561396133', 'path': '/dev/sde'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033633561396133', 'path': '/dev/sde'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-946523720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-946523720',id=25,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90e848952345455183c15fee816b6f12',ramdisk_id='',reservation_id='r-qkm6r2ju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-580785668',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:01:11Z,user_data=None,user_id='abd7a869c235467ca4da99867c6bc0d4',uuid=fa8813a4-be8c-452a-8d2d-a5fd972c2498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converting VIF {"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:f0:c8,bridge_name='br-int',has_traffic_filtering=True,id=a15cdcab-84af-42b2-bf76-a1c3027ee207,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cdcab-84') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG nova.objects.instance [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'pci_devices' on Instance uuid fa8813a4-be8c-452a-8d2d-a5fd972c2498 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:02:19 user nova-compute[74646]:   <uuid>fa8813a4-be8c-452a-8d2d-a5fd972c2498</uuid>
Oct 26 16:02:19 user nova-compute[74646]:   <name>instance-00000019</name>
Oct 26 16:02:19 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:02:19 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:02:19 user nova-compute[74646]:   <metadata>
Oct 26 16:02:19 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:02:19 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:02:19 user nova-compute[74646]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-946523720</nova:name>
Oct 26 16:02:19 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:02:16</nova:creationTime>
Oct 26 16:02:19 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:02:19 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:02:19 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:02:19 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:02:19 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:02:19 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:02:19 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:02:19 user nova-compute[74646]:       <nova:owner>
Oct 26 16:02:19 user nova-compute[74646]:         <nova:user uuid="abd7a869c235467ca4da99867c6bc0d4">tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member</nova:user>
Oct 26 16:02:19 user nova-compute[74646]:         <nova:project uuid="90e848952345455183c15fee816b6f12">tempest-ServerBootFromVolumeStableRescueTest-580785668</nova:project>
Oct 26 16:02:19 user nova-compute[74646]:       </nova:owner>
Oct 26 16:02:19 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:02:19 user nova-compute[74646]:       <nova:ports>
Oct 26 16:02:19 user nova-compute[74646]:         <nova:port uuid="a15cdcab-84af-42b2-bf76-a1c3027ee207">
Oct 26 16:02:19 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 16:02:19 user nova-compute[74646]:         </nova:port>
Oct 26 16:02:19 user nova-compute[74646]:       </nova:ports>
Oct 26 16:02:19 user nova-compute[74646]:     </nova:instance>
Oct 26 16:02:19 user nova-compute[74646]:   </metadata>
Oct 26 16:02:19 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:02:19 user nova-compute[74646]:     <system>
Oct 26 16:02:19 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:02:19 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:02:19 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:02:19 user nova-compute[74646]:       <entry name="serial">fa8813a4-be8c-452a-8d2d-a5fd972c2498</entry>
Oct 26 16:02:19 user nova-compute[74646]:       <entry name="uuid">fa8813a4-be8c-452a-8d2d-a5fd972c2498</entry>
Oct 26 16:02:19 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:02:19 user nova-compute[74646]:     </system>
Oct 26 16:02:19 user nova-compute[74646]:   </sysinfo>
Oct 26 16:02:19 user nova-compute[74646]:   <os>
Oct 26 16:02:19 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:02:19 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:02:19 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:02:19 user nova-compute[74646]:   </os>
Oct 26 16:02:19 user nova-compute[74646]:   <features>
Oct 26 16:02:19 user nova-compute[74646]:     <acpi/>
Oct 26 16:02:19 user nova-compute[74646]:     <apic/>
Oct 26 16:02:19 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:02:19 user nova-compute[74646]:   </features>
Oct 26 16:02:19 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:02:19 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:02:19 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:02:19 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:02:19 user nova-compute[74646]:   </clock>
Oct 26 16:02:19 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:02:19 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:02:19 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:02:19 user nova-compute[74646]:   </cpu>
Oct 26 16:02:19 user nova-compute[74646]:   <devices>
Oct 26 16:02:19 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:02:19 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:02:19 user nova-compute[74646]:       <source dev="/dev/sde"/>
Oct 26 16:02:19 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:02:19 user nova-compute[74646]:       <serial>6e9aa5f9-c63b-4493-b887-bc5455f9dee2</serial>
Oct 26 16:02:19 user nova-compute[74646]:     </disk>
Oct 26 16:02:19 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:02:19 user nova-compute[74646]:       <mac address="fa:16:3e:05:f0:c8"/>
Oct 26 16:02:19 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:02:19 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:02:19 user nova-compute[74646]:       <target dev="tapa15cdcab-84"/>
Oct 26 16:02:19 user nova-compute[74646]:     </interface>
Oct 26 16:02:19 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:02:19 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/console.log" append="off"/>
Oct 26 16:02:19 user nova-compute[74646]:     </serial>
Oct 26 16:02:19 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:02:19 user nova-compute[74646]:     <video>
Oct 26 16:02:19 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:02:19 user nova-compute[74646]:     </video>
Oct 26 16:02:19 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:02:19 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:02:19 user nova-compute[74646]:     </rng>
Oct 26 16:02:19 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:02:19 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:02:19 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:02:19 user nova-compute[74646]:     </memballoon>
Oct 26 16:02:19 user nova-compute[74646]:   </devices>
Oct 26 16:02:19 user nova-compute[74646]: </domain>
Oct 26 16:02:19 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-946523720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-946523720',id=25,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90e848952345455183c15fee816b6f12',ramdisk_id='',reservation_id='r-qkm6r2ju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-580785668',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:01:11Z,user_data=None,user_id='abd7a869c235467ca4da99867c6bc0d4',uuid=fa8813a4-be8c-452a-8d2d-a5fd972c2498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converting VIF {"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:f0:c8,bridge_name='br-int',has_traffic_filtering=True,id=a15cdcab-84af-42b2-bf76-a1c3027ee207,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cdcab-84') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG os_vif [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:f0:c8,bridge_name='br-int',has_traffic_filtering=True,id=a15cdcab-84af-42b2-bf76-a1c3027ee207,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cdcab-84') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f8110be-2169-5ac7-9b68-5c04e03d7ae6', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa15cdcab-84, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa15cdcab-84, col_values=(('qos', UUID('486c9504-e2f4-424d-93a8-0e5661d4b60f')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa15cdcab-84, col_values=(('external_ids', {'iface-id': 'a15cdcab-84af-42b2-bf76-a1c3027ee207', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:f0:c8', 'vm-uuid': 'fa8813a4-be8c-452a-8d2d-a5fd972c2498'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:19 user nova-compute[74646]: INFO os_vif [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:f0:c8,bridge_name='br-int',has_traffic_filtering=True,id=a15cdcab-84af-42b2-bf76-a1c3027ee207,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cdcab-84')
Oct 26 16:02:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:02:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] No VIF found with MAC fa:16:3e:05:f0:c8, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:02:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-3ee58085-6d9e-4a60-97b1-be307423450b req-be967a37-b0eb-4cd4-a5a2-0dbc4c68f149 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:02:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3ee58085-6d9e-4a60-97b1-be307423450b req-be967a37-b0eb-4cd4-a5a2-0dbc4c68f149 service nova] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3ee58085-6d9e-4a60-97b1-be307423450b req-be967a37-b0eb-4cd4-a5a2-0dbc4c68f149 service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3ee58085-6d9e-4a60-97b1-be307423450b req-be967a37-b0eb-4cd4-a5a2-0dbc4c68f149 service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-3ee58085-6d9e-4a60-97b1-be307423450b req-be967a37-b0eb-4cd4-a5a2-0dbc4c68f149 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] No waiting events found dispatching network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:02:21 user nova-compute[74646]: WARNING nova.compute.manager [req-3ee58085-6d9e-4a60-97b1-be307423450b req-be967a37-b0eb-4cd4-a5a2-0dbc4c68f149 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received unexpected event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 for instance with vm_state building and task_state spawning.
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG nova.objects.instance [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lazy-loading 'flavor' on Instance uuid 2bae2991-6c17-4d79-9dd8-1fc69322f830 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:22 user nova-compute[74646]: INFO nova.compute.manager [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Attaching volume 3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 to /dev/vdc
Oct 26 16:02:22 user nova-compute[74646]: DEBUG os_brick.utils [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ef6c6c-6d13-43c2-bee4-22000c62de77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[781584a0-8c2f-4e64-84f8-d74b290b1bd1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18113ac-79fa-4261-bd90-1c5b58580dfc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[47089f8d-5a6c-48db-bf2d-862c39b2ec97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:02:22 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d27d863-e33a-4d89-af6f-086bb5e0ea2e]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG os_brick.utils [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Updating existing volume attachment record: 6b016f8d-9741-4373-a255-a8f3c64306f5 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:02:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG nova.compute.manager [req-82a88fa6-195e-4d52-bcdf-801824cf437d req-f3459c14-8e9b-449d-b6ad-d2242a0afb88 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-82a88fa6-195e-4d52-bcdf-801824cf437d req-f3459c14-8e9b-449d-b6ad-d2242a0afb88 service nova] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-82a88fa6-195e-4d52-bcdf-801824cf437d req-f3459c14-8e9b-449d-b6ad-d2242a0afb88 service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-82a88fa6-195e-4d52-bcdf-801824cf437d req-f3459c14-8e9b-449d-b6ad-d2242a0afb88 service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG nova.compute.manager [req-82a88fa6-195e-4d52-bcdf-801824cf437d req-f3459c14-8e9b-449d-b6ad-d2242a0afb88 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] No waiting events found dispatching network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:02:23 user nova-compute[74646]: WARNING nova.compute.manager [req-82a88fa6-195e-4d52-bcdf-801824cf437d req-f3459c14-8e9b-449d-b6ad-d2242a0afb88 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received unexpected event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 for instance with vm_state building and task_state spawning.
Oct 26 16:02:23 user nova-compute[74646]: DEBUG nova.compute.manager [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:02:23 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Instance spawned successfully.
Oct 26 16:02:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:23 user nova-compute[74646]: INFO nova.compute.manager [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Took 6.93 seconds to spawn the instance on the hypervisor.
Oct 26 16:02:23 user nova-compute[74646]: DEBUG nova.compute.manager [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:23 user nova-compute[74646]: INFO nova.compute.manager [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Took 73.59 seconds to build instance.
Oct 26 16:02:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-559a0af4-0715-41c8-8445-6c594555d8e6 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 73.699s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:02:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:02:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:02:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:26 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:02:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:26 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:02:26 user nova-compute[74646]: INFO nova.compute.claims [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Claim successful on node user
Oct 26 16:02:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:02:27 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:02:27 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7527MB free_disk=25.32626724243164GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.070s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:02:27 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 51088a91-dc4a-467c-8f35-3c85a9ddd3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 96a71d00-27f0-4dbe-88cb-e6f296178e90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 696aeb6d-33b0-4fd5-9b03-91375b0c30dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance cd751613-c043-4903-b45c-1f19dccb0acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:02:27 user nova-compute[74646]: DEBUG nova.policy [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9419f9603ca647269ed1cf42e233507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a984c8da90ff476191cd5aa5787032c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:02:27 user nova-compute[74646]: INFO nova.virt.block_device [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Booting with volume snapshot 19c28e86-8a62-4b07-9966-30b0b31a13e3 at /dev/vda
Oct 26 16:02:28 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:02:28 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:02:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:02:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.663s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:28 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Successfully created port: dfeef6e7-4c83-488b-8665-ba2df944d509 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Rebuilding the list of instances to heal {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Skipping network cache update for instance because it is Building. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.objects.instance [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lazy-loading 'info_cache' on Instance uuid 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Successfully updated port: dfeef6e7-4c83-488b-8665-ba2df944d509 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "refresh_cache-4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquired lock "refresh_cache-4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-817712ec-049e-42e7-bb4a-a8afdc1b5586 req-d9c31de0-51ec-4bc6-8745-cbb8cd6ddc6f service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Received event network-changed-dfeef6e7-4c83-488b-8665-ba2df944d509 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-817712ec-049e-42e7-bb4a-a8afdc1b5586 req-d9c31de0-51ec-4bc6-8745-cbb8cd6ddc6f service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Refreshing instance network info cache due to event network-changed-dfeef6e7-4c83-488b-8665-ba2df944d509. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-817712ec-049e-42e7-bb4a-a8afdc1b5586 req-d9c31de0-51ec-4bc6-8745-cbb8cd6ddc6f service nova] Acquiring lock "refresh_cache-4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updating instance_info_cache with network_info: [{"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.network.neutron [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Updating instance_info_cache with network_info: [{"id": "dfeef6e7-4c83-488b-8665-ba2df944d509", "address": "fa:16:3e:3e:f5:9d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfeef6e7-4c", "ovs_interfaceid": "dfeef6e7-4c83-488b-8665-ba2df944d509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Releasing lock "refresh_cache-4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Instance network_info: |[{"id": "dfeef6e7-4c83-488b-8665-ba2df944d509", "address": "fa:16:3e:3e:f5:9d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfeef6e7-4c", "ovs_interfaceid": "dfeef6e7-4c83-488b-8665-ba2df944d509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-817712ec-049e-42e7-bb4a-a8afdc1b5586 req-d9c31de0-51ec-4bc6-8745-cbb8cd6ddc6f service nova] Acquired lock "refresh_cache-4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:02:29 user nova-compute[74646]: DEBUG nova.network.neutron [req-817712ec-049e-42e7-bb4a-a8afdc1b5586 req-d9c31de0-51ec-4bc6-8745-cbb8cd6ddc6f service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Refreshing network info cache for port dfeef6e7-4c83-488b-8665-ba2df944d509 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:02:30 user nova-compute[74646]: DEBUG nova.network.neutron [req-817712ec-049e-42e7-bb4a-a8afdc1b5586 req-d9c31de0-51ec-4bc6-8745-cbb8cd6ddc6f service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Updated VIF entry in instance network info cache for port dfeef6e7-4c83-488b-8665-ba2df944d509. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:02:30 user nova-compute[74646]: DEBUG nova.network.neutron [req-817712ec-049e-42e7-bb4a-a8afdc1b5586 req-d9c31de0-51ec-4bc6-8745-cbb8cd6ddc6f service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Updating instance_info_cache with network_info: [{"id": "dfeef6e7-4c83-488b-8665-ba2df944d509", "address": "fa:16:3e:3e:f5:9d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfeef6e7-4c", "ovs_interfaceid": "dfeef6e7-4c83-488b-8665-ba2df944d509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:02:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-817712ec-049e-42e7-bb4a-a8afdc1b5586 req-d9c31de0-51ec-4bc6-8745-cbb8cd6ddc6f service nova] Releasing lock "refresh_cache-4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:02:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:33 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:02:33 user nova-compute[74646]: DEBUG os_brick.utils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:02:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e58664-6134-4114-a152-96f35e15ea7f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f381157b-ce25-474c-a562-bddca5aaab64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2c1a46-c452-4be5-939e-8f391e56fa76]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9de4a37-16b6-4417-9983-a556dbfc955e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:02:34 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:02:34 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[91812853-d9e1-4a94-b55b-5ae940460678]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG os_brick.utils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Updating existing volume attachment record: 6e815d7a-57c7-4153-ac03-e1e8739218c1 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:02:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsbeEWVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:02:36 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:02:36 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:02:36 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9920e53a-1d3d-4af0-a389-58f421704e7c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:02:36 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7c6527-fe03-4f2e-93bc-eba2dbd1af3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd] added
Oct 26 16:02:36 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9bd074-591f-4be9-83e3-9a3ef116968e]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b1f01c-280a-4ebb-a631-3d53999db047]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PsbeEWVL {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PsbeEWVL" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78be5a6-4e19-4cec-ade1-64e84bdbcda3]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PsbeEWVL'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[396be46e-8c34-41b0-9f6a-9c65f14565d1]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4850a8-4c17-4143-b2c0-1b105c06624c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:36 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:36 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:36 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:02:36 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:36 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:36 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:36 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:02:36 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[017b13e9-1f79-4a26-a2ed-3e7ba92740c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd, portal: 172.16.0.220,3260]
Oct 26 16:02:36 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd, portal: 172.16.0.220,3260] successful.
Oct 26 16:02:36 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78fdbec-1d48-4a53-b46d-b3ccafbe0faf]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72b2312-abc3-42cc-bab8-e5ac80a6003b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:36 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:36 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:36 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:02:36 user nova-compute[74646]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)
Oct 26 16:02:36 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:36 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:36 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:36 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:02:36 user nova-compute[74646]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)
Oct 26 16:02:36 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] HCTL ('37', '-', '-', 0) found on session 28 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[180da0d0-6b00-41f8-a76b-cb24b4317ea7]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:36 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: None {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:02:37 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Searching for a device in session 28 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:02:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsbeEWVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:02:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.338s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:02:37 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26536636663396137', 'path': '/dev/sdf'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:02:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536636663396137', 'path': '/dev/sdf'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:02:37 user nova-compute[74646]: DEBUG nova.objects.instance [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lazy-loading 'flavor' on Instance uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:02:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:02:37 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:02:37 user nova-compute[74646]:   <source dev="/dev/sdf"/>
Oct 26 16:02:37 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:02:37 user nova-compute[74646]:   <serial>c483fded-56d0-446f-a734-29f49627d0cd</serial>
Oct 26 16:02:37 user nova-compute[74646]: </disk>
Oct 26 16:02:37 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:02:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:02:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:02:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] No VIF found with MAC fa:16:3e:cc:b0:d3, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:02:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ffc290cb-d800-4a1c-8fd7-11fc9d55fc92 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.459s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:40 user nova-compute[74646]: INFO nova.compute.manager [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Detaching volume c483fded-56d0-446f-a734-29f49627d0cd
Oct 26 16:02:40 user nova-compute[74646]: INFO nova.virt.block_device [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Attempting to driver detach volume c483fded-56d0-446f-a734-29f49627d0cd from mountpoint /dev/vdb
Oct 26 16:02:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Attempting to detach device vdb from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:02:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:02:40 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:02:40 user nova-compute[74646]:   <source dev="/dev/sdf"/>
Oct 26 16:02:40 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:02:40 user nova-compute[74646]:   <serial>c483fded-56d0-446f-a734-29f49627d0cd</serial>
Oct 26 16:02:40 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:02:40 user nova-compute[74646]: </disk>
Oct 26 16:02:40 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:02:40 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Successfully detached device vdb from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the persistent domain config.
Oct 26 16:02:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:02:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:02:40 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:02:40 user nova-compute[74646]:   <source dev="/dev/sdf"/>
Oct 26 16:02:40 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:02:40 user nova-compute[74646]:   <serial>c483fded-56d0-446f-a734-29f49627d0cd</serial>
Oct 26 16:02:40 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:02:40 user nova-compute[74646]: </disk>
Oct 26 16:02:40 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:02:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:02:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofNbcZOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:02:45 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:02:45 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:02:45 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fe30e09-d6a5-41e7-9902-85e9d7f26031]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:02:45 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d20635e-c63c-4cbf-8f0a-2298fd7cd983]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29] added
Oct 26 16:02:45 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9762aa76-fd4d-4ee4-ab3e-82cf375c7c81]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba86a24-ef68-4308-96de-ae7e47d46e65]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ofNbcZOs {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ofNbcZOs" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c7a8cb-455d-49b8-a5df-cbf49b2fa397]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ofNbcZOs'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b59b21-aba0-466e-9a47-f3e64c5e6238]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[456a4401-2626-4afb-82a4-0b0f9380702c]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)
Oct 26 16:02:45 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)
Oct 26 16:02:45 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed32974-751d-4827-9d18-2b74778f8171]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29, portal: 172.16.0.220,3260]
Oct 26 16:02:45 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29, portal: 172.16.0.220,3260] successful.
Oct 26 16:02:45 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bdb78c-10b2-4fc4-a7c8-1dd29849852f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e16c8f-567c-480c-8deb-0e0ceaac3463]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)
Oct 26 16:02:45 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)
Oct 26 16:02:45 user nova-compute[74646]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)
Oct 26 16:02:45 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[83320812-7518-4447-845b-6431f75713e9]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofNbcZOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:02:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:02:46 user nova-compute[74646]: INFO nova.compute.claims [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Claim successful on node user
Oct 26 16:02:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23261306366313063', 'path': '/dev/sdg'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261306366313063', 'path': '/dev/sdg'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.objects.instance [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lazy-loading 'flavor' on Instance uuid 2bae2991-6c17-4d79-9dd8-1fc69322f830 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:02:46 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:02:46 user nova-compute[74646]:   <source dev="/dev/sdg"/>
Oct 26 16:02:46 user nova-compute[74646]:   <target dev="vdc" bus="virtio"/>
Oct 26 16:02:46 user nova-compute[74646]:   <serial>3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29</serial>
Oct 26 16:02:46 user nova-compute[74646]: </disk>
Oct 26 16:02:46 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.network.neutron [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:02:46 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.policy [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f53e1b1d3d84c48b1ea84480b83aa71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec5750bffd274d89bc32c0aea139061c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:02:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] No VIF found with MAC fa:16:3e:6e:7d:58, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG nova.compute.manager [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:02:47 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Creating image(s)
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "/opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "/opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "/opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-aa3def9a-18e9-4cc9-8c58-f89608e8ec9d tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.805s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.207s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.183s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk 1073741824" returned: 0 in 0.052s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG nova.network.neutron [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Successfully created port: 6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.184s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Cannot resize image /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Ensure instance console log exists: /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:48 user nova-compute[74646]: INFO nova.compute.manager [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Detaching volume 3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Successfully updated port: 6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:02:48 user nova-compute[74646]: INFO nova.virt.block_device [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Attempting to driver detach volume 3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 from mountpoint /dev/vdc
Oct 26 16:02:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquired lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Attempting to detach device vdc from instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:02:48 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:02:48 user nova-compute[74646]:   <source dev="/dev/sdg"/>
Oct 26 16:02:48 user nova-compute[74646]:   <target dev="vdc" bus="virtio"/>
Oct 26 16:02:48 user nova-compute[74646]:   <serial>3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29</serial>
Oct 26 16:02:48 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 16:02:48 user nova-compute[74646]: </disk>
Oct 26 16:02:48 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:02:48 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Successfully detached device vdc from instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 from the persistent domain config.
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:02:48 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:02:48 user nova-compute[74646]:   <source dev="/dev/sdg"/>
Oct 26 16:02:48 user nova-compute[74646]:   <target dev="vdc" bus="virtio"/>
Oct 26 16:02:48 user nova-compute[74646]:   <serial>3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29</serial>
Oct 26 16:02:48 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 26 16:02:48 user nova-compute[74646]: </disk>
Oct 26 16:02:48 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-1cc0c4b7-30f8-403d-9347-c62098629733 req-8b25db2c-e608-4d92-b0a4-778c3268a11b service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-changed-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-1cc0c4b7-30f8-403d-9347-c62098629733 req-8b25db2c-e608-4d92-b0a4-778c3268a11b service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Refreshing instance network info cache due to event network-changed-6ac5e586-1f3c-4057-8e24-73a8d6de614a. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1cc0c4b7-30f8-403d-9347-c62098629733 req-8b25db2c-e608-4d92-b0a4-778c3268a11b service nova] Acquiring lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Updating instance_info_cache with network_info: [{"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Releasing lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Instance network_info: |[{"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1cc0c4b7-30f8-403d-9347-c62098629733 req-8b25db2c-e608-4d92-b0a4-778c3268a11b service nova] Acquired lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.network.neutron [req-1cc0c4b7-30f8-403d-9347-c62098629733 req-8b25db2c-e608-4d92-b0a4-778c3268a11b service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Refreshing network info cache for port 6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Start _get_guest_xml network_info=[{"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:02:48 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:02:48 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1818110104',display_name='tempest-ServerStableDeviceRescueTest-server-1818110104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1818110104',id=28,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsDVhutifjQH2fs3DJ9owCuxkPwhwBPKRt1WQ/uin9Ku9P4syVZ+tiG3bU+0TOwcMRKMrI6BoQrpoCH9bZ+c7DabwfLKDBwpYQV5HRbOJ2LXumMCWgL0Z33FIh6FgHCug==',key_name='tempest-keypair-1985130805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec5750bffd274d89bc32c0aea139061c',ramdisk_id='',reservation_id='r-ogxyw4vr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-399818180',owner_user_name='tempest-ServerStableDeviceRescueTest-399818180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:02:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f53e1b1d3d84c48b1ea84480b83aa71',uuid=9afc1e60-016b-4505-a123-8ec2f4311d84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Converting VIF {"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:2a:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ac5e586-1f3c-4057-8e24-73a8d6de614a,network=Network(7cf97893-1b8b-4791-8477-53c16f8923a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac5e586-1f') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.objects.instance [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lazy-loading 'pci_devices' on Instance uuid 9afc1e60-016b-4505-a123-8ec2f4311d84 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:02:48 user nova-compute[74646]:   <uuid>9afc1e60-016b-4505-a123-8ec2f4311d84</uuid>
Oct 26 16:02:48 user nova-compute[74646]:   <name>instance-0000001c</name>
Oct 26 16:02:48 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:02:48 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:02:48 user nova-compute[74646]:   <metadata>
Oct 26 16:02:48 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:02:48 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:02:48 user nova-compute[74646]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1818110104</nova:name>
Oct 26 16:02:48 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:02:48</nova:creationTime>
Oct 26 16:02:48 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:02:48 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:02:48 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:02:48 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:02:48 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:02:48 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:02:48 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:02:48 user nova-compute[74646]:       <nova:owner>
Oct 26 16:02:48 user nova-compute[74646]:         <nova:user uuid="2f53e1b1d3d84c48b1ea84480b83aa71">tempest-ServerStableDeviceRescueTest-399818180-project-member</nova:user>
Oct 26 16:02:48 user nova-compute[74646]:         <nova:project uuid="ec5750bffd274d89bc32c0aea139061c">tempest-ServerStableDeviceRescueTest-399818180</nova:project>
Oct 26 16:02:48 user nova-compute[74646]:       </nova:owner>
Oct 26 16:02:48 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:02:48 user nova-compute[74646]:       <nova:ports>
Oct 26 16:02:48 user nova-compute[74646]:         <nova:port uuid="6ac5e586-1f3c-4057-8e24-73a8d6de614a">
Oct 26 16:02:48 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 16:02:48 user nova-compute[74646]:         </nova:port>
Oct 26 16:02:48 user nova-compute[74646]:       </nova:ports>
Oct 26 16:02:48 user nova-compute[74646]:     </nova:instance>
Oct 26 16:02:48 user nova-compute[74646]:   </metadata>
Oct 26 16:02:48 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:02:48 user nova-compute[74646]:     <system>
Oct 26 16:02:48 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:02:48 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:02:48 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:02:48 user nova-compute[74646]:       <entry name="serial">9afc1e60-016b-4505-a123-8ec2f4311d84</entry>
Oct 26 16:02:48 user nova-compute[74646]:       <entry name="uuid">9afc1e60-016b-4505-a123-8ec2f4311d84</entry>
Oct 26 16:02:48 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:02:48 user nova-compute[74646]:     </system>
Oct 26 16:02:48 user nova-compute[74646]:   </sysinfo>
Oct 26 16:02:48 user nova-compute[74646]:   <os>
Oct 26 16:02:48 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:02:48 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:02:48 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:02:48 user nova-compute[74646]:   </os>
Oct 26 16:02:48 user nova-compute[74646]:   <features>
Oct 26 16:02:48 user nova-compute[74646]:     <acpi/>
Oct 26 16:02:48 user nova-compute[74646]:     <apic/>
Oct 26 16:02:48 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:02:48 user nova-compute[74646]:   </features>
Oct 26 16:02:48 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:02:48 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:02:48 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:02:48 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:02:48 user nova-compute[74646]:   </clock>
Oct 26 16:02:48 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:02:48 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:02:48 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:02:48 user nova-compute[74646]:   </cpu>
Oct 26 16:02:48 user nova-compute[74646]:   <devices>
Oct 26 16:02:48 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:02:48 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:02:48 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk"/>
Oct 26 16:02:48 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:02:48 user nova-compute[74646]:     </disk>
Oct 26 16:02:48 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:02:48 user nova-compute[74646]:       <mac address="fa:16:3e:d3:2a:b2"/>
Oct 26 16:02:48 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:02:48 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:02:48 user nova-compute[74646]:       <target dev="tap6ac5e586-1f"/>
Oct 26 16:02:48 user nova-compute[74646]:     </interface>
Oct 26 16:02:48 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:02:48 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/console.log" append="off"/>
Oct 26 16:02:48 user nova-compute[74646]:     </serial>
Oct 26 16:02:48 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:02:48 user nova-compute[74646]:     <video>
Oct 26 16:02:48 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:02:48 user nova-compute[74646]:     </video>
Oct 26 16:02:48 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:02:48 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:02:48 user nova-compute[74646]:     </rng>
Oct 26 16:02:48 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:02:48 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:02:48 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:02:48 user nova-compute[74646]:     </memballoon>
Oct 26 16:02:48 user nova-compute[74646]:   </devices>
Oct 26 16:02:48 user nova-compute[74646]: </domain>
Oct 26 16:02:48 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1818110104',display_name='tempest-ServerStableDeviceRescueTest-server-1818110104',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1818110104',id=28,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsDVhutifjQH2fs3DJ9owCuxkPwhwBPKRt1WQ/uin9Ku9P4syVZ+tiG3bU+0TOwcMRKMrI6BoQrpoCH9bZ+c7DabwfLKDBwpYQV5HRbOJ2LXumMCWgL0Z33FIh6FgHCug==',key_name='tempest-keypair-1985130805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ec5750bffd274d89bc32c0aea139061c',ramdisk_id='',reservation_id='r-ogxyw4vr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-399818180',owner_user_name='tempest-ServerStableDeviceRescueTest-399818180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:02:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f53e1b1d3d84c48b1ea84480b83aa71',uuid=9afc1e60-016b-4505-a123-8ec2f4311d84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Converting VIF {"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:2a:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ac5e586-1f3c-4057-8e24-73a8d6de614a,network=Network(7cf97893-1b8b-4791-8477-53c16f8923a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac5e586-1f') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG os_vif [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:2a:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ac5e586-1f3c-4057-8e24-73a8d6de614a,network=Network(7cf97893-1b8b-4791-8477-53c16f8923a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac5e586-1f') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f26e88b3-3585-5bbe-838a-f92eb5235e62', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6ac5e586-1f, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6ac5e586-1f, col_values=(('qos', UUID('fcee5dac-1e71-4b5d-b162-e9630868dab5')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6ac5e586-1f, col_values=(('external_ids', {'iface-id': '6ac5e586-1f3c-4057-8e24-73a8d6de614a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:2a:b2', 'vm-uuid': '9afc1e60-016b-4505-a123-8ec2f4311d84'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:48 user nova-compute[74646]: INFO os_vif [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:2a:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ac5e586-1f3c-4057-8e24-73a8d6de614a,network=Network(7cf97893-1b8b-4791-8477-53c16f8923a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac5e586-1f')
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:02:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] No VIF found with MAC fa:16:3e:d3:2a:b2, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:02:49 user nova-compute[74646]: DEBUG nova.network.neutron [req-1cc0c4b7-30f8-403d-9347-c62098629733 req-8b25db2c-e608-4d92-b0a4-778c3268a11b service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Updated VIF entry in instance network info cache for port 6ac5e586-1f3c-4057-8e24-73a8d6de614a. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:02:49 user nova-compute[74646]: DEBUG nova.network.neutron [req-1cc0c4b7-30f8-403d-9347-c62098629733 req-8b25db2c-e608-4d92-b0a4-778c3268a11b service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Updating instance_info_cache with network_info: [{"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:02:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1cc0c4b7-30f8-403d-9347-c62098629733 req-8b25db2c-e608-4d92-b0a4-778c3268a11b service nova] Releasing lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:02:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-306e6d6a-30ec-4879-bef4-e763405c8672 req-47728a28-0fb8-4e61-85e9-65201870784d service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:02:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-306e6d6a-30ec-4879-bef4-e763405c8672 req-47728a28-0fb8-4e61-85e9-65201870784d service nova] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-306e6d6a-30ec-4879-bef4-e763405c8672 req-47728a28-0fb8-4e61-85e9-65201870784d service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-306e6d6a-30ec-4879-bef4-e763405c8672 req-47728a28-0fb8-4e61-85e9-65201870784d service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-306e6d6a-30ec-4879-bef4-e763405c8672 req-47728a28-0fb8-4e61-85e9-65201870784d service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] No waiting events found dispatching network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:02:50 user nova-compute[74646]: WARNING nova.compute.manager [req-306e6d6a-30ec-4879-bef4-e763405c8672 req-47728a28-0fb8-4e61-85e9-65201870784d service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received unexpected event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a for instance with vm_state building and task_state spawning.
Oct 26 16:02:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-23696504-331a-40a1-afc6-dc95a5fe1e51 req-45907690-03a3-4c68-b4c0-38f9d564b1ef service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:02:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-23696504-331a-40a1-afc6-dc95a5fe1e51 req-45907690-03a3-4c68-b4c0-38f9d564b1ef service nova] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-23696504-331a-40a1-afc6-dc95a5fe1e51 req-45907690-03a3-4c68-b4c0-38f9d564b1ef service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-23696504-331a-40a1-afc6-dc95a5fe1e51 req-45907690-03a3-4c68-b4c0-38f9d564b1ef service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-23696504-331a-40a1-afc6-dc95a5fe1e51 req-45907690-03a3-4c68-b4c0-38f9d564b1ef service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] No waiting events found dispatching network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:02:52 user nova-compute[74646]: WARNING nova.compute.manager [req-23696504-331a-40a1-afc6-dc95a5fe1e51 req-45907690-03a3-4c68-b4c0-38f9d564b1ef service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received unexpected event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a for instance with vm_state building and task_state spawning.
Oct 26 16:02:53 user nova-compute[74646]: DEBUG nova.compute.manager [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:02:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:02:53 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Instance spawned successfully.
Oct 26 16:02:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:02:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:02:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:02:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:02:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:02:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:02:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:02:53 user nova-compute[74646]: INFO nova.compute.manager [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Took 6.15 seconds to spawn the instance on the hypervisor.
Oct 26 16:02:53 user nova-compute[74646]: DEBUG nova.compute.manager [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:02:53 user nova-compute[74646]: INFO nova.compute.manager [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Took 7.03 seconds to build instance.
Oct 26 16:02:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-24bf0672-a7b9-4132-b664-4766b39475b1 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.150s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:02:55 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Creating image(s)
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Ensure instance console log exists: /opt/stack/data/nova/instances/4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Start _get_guest_xml network_info=[{"id": "dfeef6e7-4c83-488b-8665-ba2df944d509", "address": "fa:16:3e:3e:f5:9d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfeef6e7-4c", "ovs_interfaceid": "dfeef6e7-4c83-488b-8665-ba2df944d509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '6e815d7a-57c7-4153-ac03-e1e8739218c1', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uphGitOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f', 'attached_at': '', 'detached_at': '', 'volume_id': '81e297b2-3f4c-47fb-8651-9e856d30201c', 'serial': '81e297b2-3f4c-47fb-8651-9e856d30201c'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:02:55 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:02:55 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uphGitOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:02:55 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:02:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:02:55 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:02:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:02:55 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:02:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3c92e6-1509-4259-8920-2f0b6a33f864]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:02:55 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae3bcf3-0d68-4ce9-8c88-aa47ae72935f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c] added
Oct 26 16:02:55 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d3a797-54ce-4caa-b3ef-3f36b23c59d7]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c68612-53f7-4874-8a2c-d32fe7dc5089]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uphGitOl {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uphGitOl" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[027bfba5-6dae-4aad-8035-79be923fbfff]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uphGitOl'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca3b8b2-f4af-427f-bb87-d4833e2794a1]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e8f9ac-45d7-4687-9866-a46b70712140]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f123a92-2347-40bb-b4a0-e316c327c2e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c, portal: 172.16.0.220,3260]
Oct 26 16:02:56 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c, portal: 172.16.0.220,3260] successful.
Oct 26 16:02:56 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbadbd0d-820d-4bf9-af1c-39721406a3c6]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba5db62-15e4-416e-ade6-683d61634649]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:02:56 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)
Oct 26 16:02:56 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:02:56 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.428s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] HCTL ('39', '-', '-', 0) found on session 30 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[39981689-d7c0-46f9-a2b3-4f63c7146c61]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: None {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-accceb08-5ac1-43aa-a670-93249596841f req-44dcf32f-5cbd-4f37-99b9-832bbaad1128 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Received event network-changed-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-accceb08-5ac1-43aa-a670-93249596841f req-44dcf32f-5cbd-4f37-99b9-832bbaad1128 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Refreshing instance network info cache due to event network-changed-e76cc0df-d5d8-4cd5-abf4-cec6e536db86. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-accceb08-5ac1-43aa-a670-93249596841f req-44dcf32f-5cbd-4f37-99b9-832bbaad1128 service nova] Acquiring lock "refresh_cache-696aeb6d-33b0-4fd5-9b03-91375b0c30dc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-accceb08-5ac1-43aa-a670-93249596841f req-44dcf32f-5cbd-4f37-99b9-832bbaad1128 service nova] Acquired lock "refresh_cache-696aeb6d-33b0-4fd5-9b03-91375b0c30dc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:02:56 user nova-compute[74646]: DEBUG nova.network.neutron [req-accceb08-5ac1-43aa-a670-93249596841f req-44dcf32f-5cbd-4f37-99b9-832bbaad1128 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Refreshing network info cache for port e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.network.neutron [req-accceb08-5ac1-43aa-a670-93249596841f req-44dcf32f-5cbd-4f37-99b9-832bbaad1128 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Updated VIF entry in instance network info cache for port e76cc0df-d5d8-4cd5-abf4-cec6e536db86. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.network.neutron [req-accceb08-5ac1-43aa-a670-93249596841f req-44dcf32f-5cbd-4f37-99b9-832bbaad1128 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Updating instance_info_cache with network_info: [{"id": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "address": "fa:16:3e:fd:e3:3f", "network": {"id": "0c31a8ed-93d5-4264-a423-1be36f607e77", "bridge": "br-int", "label": "tempest-TestStampPattern-1455596049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1aa9710cad4f8493c3ed49167ff876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76cc0df-d5", "ovs_interfaceid": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-accceb08-5ac1-43aa-a670-93249596841f req-44dcf32f-5cbd-4f37-99b9-832bbaad1128 service nova] Releasing lock "refresh_cache-696aeb6d-33b0-4fd5-9b03-91375b0c30dc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Acquiring lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.objects.instance [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lazy-loading 'flavor' on Instance uuid 696aeb6d-33b0-4fd5-9b03-91375b0c30dc {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching for a device in session 30 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uphGitOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.466s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '23361623537323363', 'path': '/dev/sdh'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361623537323363', 'path': '/dev/sdh'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Acquiring lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:57 user nova-compute[74646]: INFO nova.compute.manager [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Attaching volume 75b1fa96-c34b-49ee-a2a7-91398ce69ab1 to /dev/vdb
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2064777453',display_name='tempest-TestVolumeBootPattern-server-2064777453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2064777453',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-v6tle7uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:02:28Z,user_data=None,user_id='9419f9603ca647269ed1cf42e233507f',uuid=4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfeef6e7-4c83-488b-8665-ba2df944d509", "address": "fa:16:3e:3e:f5:9d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfeef6e7-4c", "ovs_interfaceid": "dfeef6e7-4c83-488b-8665-ba2df944d509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "dfeef6e7-4c83-488b-8665-ba2df944d509", "address": "fa:16:3e:3e:f5:9d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfeef6e7-4c", "ovs_interfaceid": "dfeef6e7-4c83-488b-8665-ba2df944d509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f5:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfeef6e7-4c83-488b-8665-ba2df944d509,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfeef6e7-4c') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.objects.instance [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:02:57 user nova-compute[74646]:   <uuid>4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f</uuid>
Oct 26 16:02:57 user nova-compute[74646]:   <name>instance-0000001b</name>
Oct 26 16:02:57 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:02:57 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:02:57 user nova-compute[74646]:   <metadata>
Oct 26 16:02:57 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:02:57 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:02:57 user nova-compute[74646]:       <nova:name>tempest-TestVolumeBootPattern-server-2064777453</nova:name>
Oct 26 16:02:57 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:02:55</nova:creationTime>
Oct 26 16:02:57 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:02:57 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:02:57 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:02:57 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:02:57 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:02:57 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:02:57 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:02:57 user nova-compute[74646]:       <nova:owner>
Oct 26 16:02:57 user nova-compute[74646]:         <nova:user uuid="9419f9603ca647269ed1cf42e233507f">tempest-TestVolumeBootPattern-1231840017-project-member</nova:user>
Oct 26 16:02:57 user nova-compute[74646]:         <nova:project uuid="a984c8da90ff476191cd5aa5787032c1">tempest-TestVolumeBootPattern-1231840017</nova:project>
Oct 26 16:02:57 user nova-compute[74646]:       </nova:owner>
Oct 26 16:02:57 user nova-compute[74646]:       <nova:ports>
Oct 26 16:02:57 user nova-compute[74646]:         <nova:port uuid="dfeef6e7-4c83-488b-8665-ba2df944d509">
Oct 26 16:02:57 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 16:02:57 user nova-compute[74646]:         </nova:port>
Oct 26 16:02:57 user nova-compute[74646]:       </nova:ports>
Oct 26 16:02:57 user nova-compute[74646]:     </nova:instance>
Oct 26 16:02:57 user nova-compute[74646]:   </metadata>
Oct 26 16:02:57 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:02:57 user nova-compute[74646]:     <system>
Oct 26 16:02:57 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:02:57 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:02:57 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:02:57 user nova-compute[74646]:       <entry name="serial">4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f</entry>
Oct 26 16:02:57 user nova-compute[74646]:       <entry name="uuid">4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f</entry>
Oct 26 16:02:57 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:02:57 user nova-compute[74646]:     </system>
Oct 26 16:02:57 user nova-compute[74646]:   </sysinfo>
Oct 26 16:02:57 user nova-compute[74646]:   <os>
Oct 26 16:02:57 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:02:57 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:02:57 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:02:57 user nova-compute[74646]:   </os>
Oct 26 16:02:57 user nova-compute[74646]:   <features>
Oct 26 16:02:57 user nova-compute[74646]:     <acpi/>
Oct 26 16:02:57 user nova-compute[74646]:     <apic/>
Oct 26 16:02:57 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:02:57 user nova-compute[74646]:   </features>
Oct 26 16:02:57 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:02:57 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:02:57 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:02:57 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:02:57 user nova-compute[74646]:   </clock>
Oct 26 16:02:57 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:02:57 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:02:57 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:02:57 user nova-compute[74646]:   </cpu>
Oct 26 16:02:57 user nova-compute[74646]:   <devices>
Oct 26 16:02:57 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:02:57 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:02:57 user nova-compute[74646]:       <source dev="/dev/sdh"/>
Oct 26 16:02:57 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:02:57 user nova-compute[74646]:       <serial>81e297b2-3f4c-47fb-8651-9e856d30201c</serial>
Oct 26 16:02:57 user nova-compute[74646]:     </disk>
Oct 26 16:02:57 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:02:57 user nova-compute[74646]:       <mac address="fa:16:3e:3e:f5:9d"/>
Oct 26 16:02:57 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:02:57 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:02:57 user nova-compute[74646]:       <target dev="tapdfeef6e7-4c"/>
Oct 26 16:02:57 user nova-compute[74646]:     </interface>
Oct 26 16:02:57 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:02:57 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f/console.log" append="off"/>
Oct 26 16:02:57 user nova-compute[74646]:     </serial>
Oct 26 16:02:57 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:02:57 user nova-compute[74646]:     <video>
Oct 26 16:02:57 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:02:57 user nova-compute[74646]:     </video>
Oct 26 16:02:57 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:02:57 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:02:57 user nova-compute[74646]:     </rng>
Oct 26 16:02:57 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:02:57 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:02:57 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:02:57 user nova-compute[74646]:     </memballoon>
Oct 26 16:02:57 user nova-compute[74646]:   </devices>
Oct 26 16:02:57 user nova-compute[74646]: </domain>
Oct 26 16:02:57 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2064777453',display_name='tempest-TestVolumeBootPattern-server-2064777453',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2064777453',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-v6tle7uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:02:28Z,user_data=None,user_id='9419f9603ca647269ed1cf42e233507f',uuid=4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dfeef6e7-4c83-488b-8665-ba2df944d509", "address": "fa:16:3e:3e:f5:9d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfeef6e7-4c", "ovs_interfaceid": "dfeef6e7-4c83-488b-8665-ba2df944d509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "dfeef6e7-4c83-488b-8665-ba2df944d509", "address": "fa:16:3e:3e:f5:9d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfeef6e7-4c", "ovs_interfaceid": "dfeef6e7-4c83-488b-8665-ba2df944d509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f5:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfeef6e7-4c83-488b-8665-ba2df944d509,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfeef6e7-4c') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG os_vif [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f5:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfeef6e7-4c83-488b-8665-ba2df944d509,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfeef6e7-4c') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44c9eb01-7dbd-5fd4-a538-506c49c2672f', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdfeef6e7-4c, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdfeef6e7-4c, col_values=(('qos', UUID('c7598fde-de92-42a7-ae48-7add4eea56e1')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdfeef6e7-4c, col_values=(('external_ids', {'iface-id': 'dfeef6e7-4c83-488b-8665-ba2df944d509', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:f5:9d', 'vm-uuid': '4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:57 user nova-compute[74646]: INFO os_vif [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f5:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfeef6e7-4c83-488b-8665-ba2df944d509,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfeef6e7-4c')
Oct 26 16:02:57 user nova-compute[74646]: DEBUG os_brick.utils [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[015e66a9-de2f-485a-b591-09dbe8e6dfc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[83320df9-9342-4a74-ae55-c37a5421feec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] No VIF found with MAC fa:16:3e:3e:f5:9d, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a946059-f3d3-48fb-abdb-832b47a057e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[38aa9db9-6c09-4c2d-baec-a9e8052ea588]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:02:57 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:02:57 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7cef033-794f-4f9e-80fc-eb9f20cab609]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG os_brick.utils [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:02:57 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Updating existing volume attachment record: dd27dce8-c998-4f8b-b68b-a0581744de8a {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:02:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-8178fc53-b7e5-49a6-a4f3-f9de2f58d47b req-fe05a613-8ab2-4c13-b3fb-deb61fbea98e service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Received event network-vif-plugged-dfeef6e7-4c83-488b-8665-ba2df944d509 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:02:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8178fc53-b7e5-49a6-a4f3-f9de2f58d47b req-fe05a613-8ab2-4c13-b3fb-deb61fbea98e service nova] Acquiring lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:02:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8178fc53-b7e5-49a6-a4f3-f9de2f58d47b req-fe05a613-8ab2-4c13-b3fb-deb61fbea98e service nova] Lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:02:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8178fc53-b7e5-49a6-a4f3-f9de2f58d47b req-fe05a613-8ab2-4c13-b3fb-deb61fbea98e service nova] Lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:02:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-8178fc53-b7e5-49a6-a4f3-f9de2f58d47b req-fe05a613-8ab2-4c13-b3fb-deb61fbea98e service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] No waiting events found dispatching network-vif-plugged-dfeef6e7-4c83-488b-8665-ba2df944d509 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:02:59 user nova-compute[74646]: WARNING nova.compute.manager [req-8178fc53-b7e5-49a6-a4f3-f9de2f58d47b req-fe05a613-8ab2-4c13-b3fb-deb61fbea98e service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Received unexpected event network-vif-plugged-dfeef6e7-4c83-488b-8665-ba2df944d509 for instance with vm_state building and task_state spawning.
Oct 26 16:02:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:02:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:00 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 is timed out.
Oct 26 16:03:00 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Successfully detached device vdb from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the live domain config.
Oct 26 16:03:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PsbeEWVL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:03:00 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13c26b6-c563-47d4-ac38-a0a235a60473]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:03:00 user nova-compute[74646]: No targets found.
Oct 26 16:03:00 user nova-compute[74646]: iSNS:
Oct 26 16:03:00 user nova-compute[74646]: No targets found.
Oct 26 16:03:00 user nova-compute[74646]: STATIC:
Oct 26 16:03:00 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c
Oct 26 16:03:00 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:00 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:00 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd
Oct 26 16:03:00 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:00 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:00 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a
Oct 26 16:03:00 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:00 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:00 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886
Oct 26 16:03:00 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:00 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:00 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:03:00 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:00 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:00 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29
Oct 26 16:03:00 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:00 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:00 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509
Oct 26 16:03:00 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:00 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:00 user nova-compute[74646]: FIRMWARE:
Oct 26 16:03:00 user nova-compute[74646]: No targets found.
Oct 26 16:03:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:03:00 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:03:00 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[448f9816-5d38-4743-8d45-8b294c817810]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8eb641c-2718-46be-9aea-df534cbebbdb]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:03:00 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:03:00 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:03:00 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:03:00 user nova-compute[74646]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)
Oct 26 16:03:00 user nova-compute[74646]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)
Oct 26 16:03:00 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:03:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:03:00 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:03:00 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:03:00 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:03:00 user nova-compute[74646]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd (non-flash)
Oct 26 16:03:00 user nova-compute[74646]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)
Oct 26 16:03:00 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:03:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e01fd7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd'): ({'sdf'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Removing single pathed devices sdf {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ea7ddd-159e-4e71-81e4-eddd3da02e13]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1feb808e-09fa-4aed-b6e9-65ed48840568]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Flushing IO for device /dev/sdf {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b592844-264f-48a4-9ad8-73109cc6982e]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[106a3a63-ef4a-4166-b56a-47e4ee91e4cf]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] SCSI volumes sdf have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d0c4f3-d5a3-4721-9b80-13511c626665]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[de658c24-0cfa-480a-b5d9-35bc1dbde0c6]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd, portal: 172.16.0.220,3260]
Oct 26 16:03:00 user nova-compute[74646]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd, portal: 172.16.0.220,3260] successful.
Oct 26 16:03:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c483fded-56d0-446f-a734-29f49627d0cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[47afe3d7-cd66-4587-84f3-de627e1bac0a]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] <== disconnect_volume: return (349ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:03:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:03:01 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:03:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:03:01 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Instance spawned successfully.
Oct 26 16:03:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:03:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-46d29ffc-9cb9-46ab-96b7-9b9a5aafaf9a req-d3a5769a-de34-42c0-aa59-2732f2b1af62 service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Received event network-vif-plugged-dfeef6e7-4c83-488b-8665-ba2df944d509 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:03:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-46d29ffc-9cb9-46ab-96b7-9b9a5aafaf9a req-d3a5769a-de34-42c0-aa59-2732f2b1af62 service nova] Acquiring lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-46d29ffc-9cb9-46ab-96b7-9b9a5aafaf9a req-d3a5769a-de34-42c0-aa59-2732f2b1af62 service nova] Lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-46d29ffc-9cb9-46ab-96b7-9b9a5aafaf9a req-d3a5769a-de34-42c0-aa59-2732f2b1af62 service nova] Lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-46d29ffc-9cb9-46ab-96b7-9b9a5aafaf9a req-d3a5769a-de34-42c0-aa59-2732f2b1af62 service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] No waiting events found dispatching network-vif-plugged-dfeef6e7-4c83-488b-8665-ba2df944d509 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:03:01 user nova-compute[74646]: WARNING nova.compute.manager [req-46d29ffc-9cb9-46ab-96b7-9b9a5aafaf9a req-d3a5769a-de34-42c0-aa59-2732f2b1af62 service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Received unexpected event network-vif-plugged-dfeef6e7-4c83-488b-8665-ba2df944d509 for instance with vm_state building and task_state spawning.
Oct 26 16:03:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:03:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:03:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:03:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:03:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:03:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:03:01 user nova-compute[74646]: INFO nova.compute.manager [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Took 5.44 seconds to spawn the instance on the hypervisor.
Oct 26 16:03:01 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:03:01 user nova-compute[74646]: INFO nova.compute.manager [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Took 34.95 seconds to build instance.
Oct 26 16:03:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c6034e4e-baf3-49f9-8224-148d8421e997 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.122s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:01 user nova-compute[74646]: DEBUG nova.objects.instance [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lazy-loading 'flavor' on Instance uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:03:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b1decbd9-ee89-4aa9-b732-f5208fa783c3 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.004s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:08 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 is timed out.
Oct 26 16:03:08 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Successfully detached device vdc from instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 from the live domain config.
Oct 26 16:03:08 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ofNbcZOs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:03:08 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:03:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af39720-3c7d-440f-91f0-b255bcf3c8df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:03:08 user nova-compute[74646]: No targets found.
Oct 26 16:03:08 user nova-compute[74646]: iSNS:
Oct 26 16:03:08 user nova-compute[74646]: No targets found.
Oct 26 16:03:08 user nova-compute[74646]: STATIC:
Oct 26 16:03:08 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c
Oct 26 16:03:08 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:08 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:08 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a
Oct 26 16:03:08 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:08 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:08 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886
Oct 26 16:03:08 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:08 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:08 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:03:08 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:08 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:08 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29
Oct 26 16:03:08 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:08 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:08 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509
Oct 26 16:03:08 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:08 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:08 user nova-compute[74646]: FIRMWARE:
Oct 26 16:03:08 user nova-compute[74646]: No targets found.
Oct 26 16:03:08 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:03:08 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:03:08 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6a5985-9bc9-499e-b5c3-da911e45c721]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[394a9c23-6f97-4eec-af87-ecb4979f55b1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:03:08 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:03:08 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:03:08 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:03:08 user nova-compute[74646]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)
Oct 26 16:03:08 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:03:08 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:03:08 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:03:08 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:03:08 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:03:08 user nova-compute[74646]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 (non-flash)
Oct 26 16:03:08 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:03:08 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e01cd900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29'): ({'sdg'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Removing single pathed devices sdg {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:03:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[408e9df3-2df8-4dbc-ba7e-fd6e8cb84620]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5321881-dc11-4d1a-8b05-c5fc6d9332c3]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Flushing IO for device /dev/sdg {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cbbe0f-0385-47b2-aa60-891537e1e20f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68b81b2-6cdd-43ba-ac66-a488a5cc4319]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] SCSI volumes sdg have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3573bd1a-176d-4992-af0d-c6433a51cd9d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b642dd-569c-44ec-b1e3-dcc2051a6186]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29, portal: 172.16.0.220,3260]
Oct 26 16:03:09 user nova-compute[74646]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29, portal: 172.16.0.220,3260] successful.
Oct 26 16:03:09 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e9d1cdc-91dd-4df1-aa1a-0caf2d7e5f29 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ba325f3-d59e-46b4-ac42-e680d285d5e6]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] <== disconnect_volume: return (330ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:03:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:03:10 user nova-compute[74646]: DEBUG nova.objects.instance [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lazy-loading 'flavor' on Instance uuid 2bae2991-6c17-4d79-9dd8-1fc69322f830 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:03:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-68f1f717-f43a-45b9-8dd1-7380130de701 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.883s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:11 user nova-compute[74646]: DEBUG nova.compute.manager [req-e7c35737-e51f-4254-839d-00e817bafcd3 req-cb784fa2-d84d-484b-891c-1171671872c9 service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Received event network-changed-19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:03:11 user nova-compute[74646]: DEBUG nova.compute.manager [req-e7c35737-e51f-4254-839d-00e817bafcd3 req-cb784fa2-d84d-484b-891c-1171671872c9 service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Refreshing instance network info cache due to event network-changed-19fab0cc-b1c5-471b-8fae-30eec3d6659c. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:03:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e7c35737-e51f-4254-839d-00e817bafcd3 req-cb784fa2-d84d-484b-891c-1171671872c9 service nova] Acquiring lock "refresh_cache-cd751613-c043-4903-b45c-1f19dccb0acb" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:03:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e7c35737-e51f-4254-839d-00e817bafcd3 req-cb784fa2-d84d-484b-891c-1171671872c9 service nova] Acquired lock "refresh_cache-cd751613-c043-4903-b45c-1f19dccb0acb" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:03:11 user nova-compute[74646]: DEBUG nova.network.neutron [req-e7c35737-e51f-4254-839d-00e817bafcd3 req-cb784fa2-d84d-484b-891c-1171671872c9 service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Refreshing network info cache for port 19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:03:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "cd751613-c043-4903-b45c-1f19dccb0acb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "cd751613-c043-4903-b45c-1f19dccb0acb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:11 user nova-compute[74646]: DEBUG nova.objects.instance [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lazy-loading 'flavor' on Instance uuid cd751613-c043-4903-b45c-1f19dccb0acb {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:03:11 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Ignoring supplied device name: /dev/vdb
Oct 26 16:03:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "cd751613-c043-4903-b45c-1f19dccb0acb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-e7c35737-e51f-4254-839d-00e817bafcd3 req-cb784fa2-d84d-484b-891c-1171671872c9 service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Updated VIF entry in instance network info cache for port 19fab0cc-b1c5-471b-8fae-30eec3d6659c. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-e7c35737-e51f-4254-839d-00e817bafcd3 req-cb784fa2-d84d-484b-891c-1171671872c9 service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Updating instance_info_cache with network_info: [{"id": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "address": "fa:16:3e:07:b0:59", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19fab0cc-b1", "ovs_interfaceid": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e7c35737-e51f-4254-839d-00e817bafcd3 req-cb784fa2-d84d-484b-891c-1171671872c9 service nova] Releasing lock "refresh_cache-cd751613-c043-4903-b45c-1f19dccb0acb" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "cd751613-c043-4903-b45c-1f19dccb0acb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "cd751613-c043-4903-b45c-1f19dccb0acb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:12 user nova-compute[74646]: INFO nova.compute.manager [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Attaching volume 8f898821-3888-4bc8-9957-783fc1f36335 to /dev/vdb
Oct 26 16:03:12 user nova-compute[74646]: DEBUG os_brick.utils [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb2e95d-34cc-4b6b-80b8-277ceb64d5dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[155bd65d-07f7-4c21-8a6e-8dfae1666bb4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1672c5c-b7d6-48bc-b21d-d432ebc27605]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa4e00c-fb86-41a2-a3a8-f3d6173e4047]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:03:12 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:03:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6804c6d3-cc4b-4056-924b-7c2fdccbb01d]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG os_brick.utils [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Updating existing volume attachment record: 631f2c47-1896-4a5c-8480-31ae821e710d {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:03:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.volume.cinder [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Update attachment failed for attachment dd27dce8-c998-4f8b-b68b-a0581744de8a. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2ec6eb69-1fce-4803-8c44-056c178cbf7a) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2ec6eb69-1fce-4803-8c44-056c178cbf7a)
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Failed to attach 75b1fa96-c34b-49ee-a2a7-91398ce69ab1 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2ec6eb69-1fce-4803-8c44-056c178cbf7a)
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Traceback (most recent call last):
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     ret_val = method(obj, context, *args, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     self._do_attach(context, instance, volume, volume_api,
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     self._volume_attach(context, volume, connector, instance,
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     connection_info = volume_api.attachment_update(
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     res = method(self, ctx, *args, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     with excutils.save_and_reraise_exception():
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     self.force_reraise()
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     raise self.value
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     return method.func(obj, *args, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     resp = self._update('/attachments/%s' % id, body)
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     return self.request(url, method, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc]     raise exceptions.from_response(resp, body)
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2ec6eb69-1fce-4803-8c44-056c178cbf7a)
Oct 26 16:03:20 user nova-compute[74646]: ERROR nova.compute.manager [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] 
Oct 26 16:03:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.847s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server [None req-b3e065ff-f827-4445-879d-c100d8418355 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2ec6eb69-1fce-4803-8c44-056c178cbf7a)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2ec6eb69-1fce-4803-8c44-056c178cbf7a)
Oct 26 16:03:20 user nova-compute[74646]: ERROR oslo_messaging.rpc.server 
Oct 26 16:03:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:20 user nova-compute[74646]: INFO nova.compute.manager [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Terminating instance
Oct 26 16:03:20 user nova-compute[74646]: DEBUG nova.compute.manager [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG nova.compute.manager [req-dd95c7e4-87e9-4f53-a45d-5fada9e25265 req-282c6099-e797-4cbe-af66-b818af2b8fc3 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Received event network-vif-unplugged-e7148f30-9808-4eaa-a3e1-007a3b5755d6 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dd95c7e4-87e9-4f53-a45d-5fada9e25265 req-282c6099-e797-4cbe-af66-b818af2b8fc3 service nova] Acquiring lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dd95c7e4-87e9-4f53-a45d-5fada9e25265 req-282c6099-e797-4cbe-af66-b818af2b8fc3 service nova] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dd95c7e4-87e9-4f53-a45d-5fada9e25265 req-282c6099-e797-4cbe-af66-b818af2b8fc3 service nova] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG nova.compute.manager [req-dd95c7e4-87e9-4f53-a45d-5fada9e25265 req-282c6099-e797-4cbe-af66-b818af2b8fc3 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] No waiting events found dispatching network-vif-unplugged-e7148f30-9808-4eaa-a3e1-007a3b5755d6 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG nova.compute.manager [req-dd95c7e4-87e9-4f53-a45d-5fada9e25265 req-282c6099-e797-4cbe-af66-b818af2b8fc3 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Received event network-vif-unplugged-e7148f30-9808-4eaa-a3e1-007a3b5755d6 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:03:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:21 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Instance destroyed successfully.
Oct 26 16:03:21 user nova-compute[74646]: DEBUG nova.objects.instance [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lazy-loading 'resources' on Instance uuid 51088a91-dc4a-467c-8f35-3c85a9ddd3c4 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:57:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-685771773',display_name='tempest-TestMinimumBasicScenario-server-685771773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-685771773',id=19,image_ref='4ec27269-d015-4036-b13b-215b23be7635',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK87Tk62ZhsU/CG61uxDFSMzEXBGqUyFfRKvclBbtaJL4ojv/IQ2BQXPr33URLQyWXeqOD7CXILgdKs6RXTePkEyEi6UxF9Y2EwVLGzAzxASqMQs2iQaEXXC/nH/4qukHg==',key_name='tempest-TestMinimumBasicScenario-1356218599',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:58:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e982f0135534a22ba32bb089b85d3f3',ramdisk_id='',reservation_id='r-0n2p8zgx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4ec27269-d015-4036-b13b-215b23be7635',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1275819184',owner_user_name='tempest-TestMinimumBasicScenario-1275819184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:58:03Z,user_data=None,user_id='e00e398f6dc344f4afaa44c119f87f2b',uuid=51088a91-dc4a-467c-8f35-3c85a9ddd3c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "address": "fa:16:3e:6e:de:12", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7148f30-98", "ovs_interfaceid": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Converting VIF {"id": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "address": "fa:16:3e:6e:de:12", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape7148f30-98", "ovs_interfaceid": "e7148f30-9808-4eaa-a3e1-007a3b5755d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:de:12,bridge_name='br-int',has_traffic_filtering=True,id=e7148f30-9808-4eaa-a3e1-007a3b5755d6,network=Network(771871f2-36c1-4cc5-aa99-b2687f67b96c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7148f30-98') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG os_vif [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:de:12,bridge_name='br-int',has_traffic_filtering=True,id=e7148f30-9808-4eaa-a3e1-007a3b5755d6,network=Network(771871f2-36c1-4cc5-aa99-b2687f67b96c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7148f30-98') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape7148f30-98, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=603fd654-9e37-4ee4-b2f0-fd8b09bcd655) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:21 user nova-compute[74646]: INFO os_vif [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:de:12,bridge_name='br-int',has_traffic_filtering=True,id=e7148f30-9808-4eaa-a3e1-007a3b5755d6,network=Network(771871f2-36c1-4cc5-aa99-b2687f67b96c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape7148f30-98')
Oct 26 16:03:21 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Deleting instance files /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4_del
Oct 26 16:03:21 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Deletion of /opt/stack/data/nova/instances/51088a91-dc4a-467c-8f35-3c85a9ddd3c4_del complete
Oct 26 16:03:21 user nova-compute[74646]: INFO nova.compute.manager [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 26 16:03:21 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:21 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:03:22 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Took 0.57 seconds to deallocate network for instance.
Oct 26 16:03:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-953fba72-6234-4492-91fb-db5b24875055 req-d811eab5-0b28-4a02-8763-048326601526 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Received event network-vif-deleted-e7148f30-9808-4eaa-a3e1-007a3b5755d6 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:03:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:22 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:03:22 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:03:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:22 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Deleted allocations for instance 51088a91-dc4a-467c-8f35-3c85a9ddd3c4
Oct 26 16:03:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e4368fe7-42f6-4c14-bc73-c43b7b46b06d tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.056s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:23 user nova-compute[74646]: DEBUG nova.compute.manager [req-18b6f9c0-1faa-405a-9f60-f3dec36602f9 req-2fa3d029-f009-4696-ae98-95122d6fe407 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Received event network-vif-plugged-e7148f30-9808-4eaa-a3e1-007a3b5755d6 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:03:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-18b6f9c0-1faa-405a-9f60-f3dec36602f9 req-2fa3d029-f009-4696-ae98-95122d6fe407 service nova] Acquiring lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-18b6f9c0-1faa-405a-9f60-f3dec36602f9 req-2fa3d029-f009-4696-ae98-95122d6fe407 service nova] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-18b6f9c0-1faa-405a-9f60-f3dec36602f9 req-2fa3d029-f009-4696-ae98-95122d6fe407 service nova] Lock "51088a91-dc4a-467c-8f35-3c85a9ddd3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:23 user nova-compute[74646]: DEBUG nova.compute.manager [req-18b6f9c0-1faa-405a-9f60-f3dec36602f9 req-2fa3d029-f009-4696-ae98-95122d6fe407 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] No waiting events found dispatching network-vif-plugged-e7148f30-9808-4eaa-a3e1-007a3b5755d6 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:03:23 user nova-compute[74646]: WARNING nova.compute.manager [req-18b6f9c0-1faa-405a-9f60-f3dec36602f9 req-2fa3d029-f009-4696-ae98-95122d6fe407 service nova] [instance: 51088a91-dc4a-467c-8f35-3c85a9ddd3c4] Received unexpected event network-vif-plugged-e7148f30-9808-4eaa-a3e1-007a3b5755d6 for instance with vm_state deleted and task_state None.
Oct 26 16:03:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:03:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:03:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:03:24 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:03:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:03:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:24 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:03:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:03:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:03:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:03:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:03:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:03:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:28 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:03:28 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:03:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7342MB free_disk=25.319747924804688GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 96a71d00-27f0-4dbe-88cb-e6f296178e90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 696aeb6d-33b0-4fd5-9b03-91375b0c30dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance cd751613-c043-4903-b45c-1f19dccb0acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9afc1e60-016b-4505-a123-8ec2f4311d84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:03:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:03:29 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:03:29 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:03:29 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:03:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.540s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:03:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:03:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:03:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:03:30 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:03:30 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating instance_info_cache with network_info: [{"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:03:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-96a71d00-27f0-4dbe-88cb-e6f296178e90" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:03:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:03:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:03:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:03:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:03:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnPIspuY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:03:32 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:03:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:03:32 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:03:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:03:32 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e81403-5856-4e4d-a574-b8fea942449f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:03:32 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7200c14-2e6f-4c03-8d50-3385a331aecc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335] added
Oct 26 16:03:32 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2712b25a-7750-4e66-830c-e88b150c11dc]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb93ac8c-d33e-4de3-b693-6d3f28483f42]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnPIspuY {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QnPIspuY" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f61a65-7650-4ee4-a1ac-3a5587631264]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QnPIspuY'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.047s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[06627984-006f-4f47-9854-047a74e6b56b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[43736bb9-47f0-4589-9437-d6607302fcc2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:03:32 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:03:32 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:03:32 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:03:32 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:03:32 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:03:32 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:03:32 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:03:32 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:03:32 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:03:32 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:03:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b214c7d-b154-4fc0-a798-36477cf50402]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335, portal: 172.16.0.220,3260]
Oct 26 16:03:33 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335, portal: 172.16.0.220,3260] successful.
Oct 26 16:03:33 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9370c19c-19c7-4586-8e4f-ad37315ac1c5]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cee0321-17b9-4c20-bb9d-d45b48001e82]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:03:33 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:03:33 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:03:33 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:03:33 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:03:33 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:03:33 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:03:33 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:03:33 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:03:33 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:03:33 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:03:33 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:03:33 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9ef969-163b-4c1c-a8c3-306645ca0201]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnPIspuY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:03:33 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:03:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:03:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23237633133393561', 'path': '/dev/sdf'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:03:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237633133393561', 'path': '/dev/sdf'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:03:34 user nova-compute[74646]: DEBUG nova.objects.instance [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lazy-loading 'flavor' on Instance uuid cd751613-c043-4903-b45c-1f19dccb0acb {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:03:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:03:34 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:03:34 user nova-compute[74646]:   <source dev="/dev/sdf"/>
Oct 26 16:03:34 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:03:34 user nova-compute[74646]:   <serial>8f898821-3888-4bc8-9957-783fc1f36335</serial>
Oct 26 16:03:34 user nova-compute[74646]: </disk>
Oct 26 16:03:34 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:03:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:03:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:03:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] No VIF found with MAC fa:16:3e:07:b0:59, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:03:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-29300c0f-0abb-4609-b343-9c5392d61e7a tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "cd751613-c043-4903-b45c-1f19dccb0acb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.514s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG nova.objects.instance [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lazy-loading 'flavor' on Instance uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:35 user nova-compute[74646]: INFO nova.compute.manager [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Attaching volume 998293e6-dd21-44fb-ac03-31edff3e383c to /dev/vdb
Oct 26 16:03:35 user nova-compute[74646]: DEBUG os_brick.utils [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6a3993-7ac5-4567-a174-065bb90248dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4c4dd7-aef3-4f84-8e89-950e2c2748e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1698456c-d94b-42a0-a13c-b84507f1e520]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed12c1d4-81b2-4b50-8086-0918b06ca70e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:03:35 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:03:35 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb4ec5e-ffec-4d9e-bcd9-b2bc61ad9f41]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG os_brick.utils [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Updating existing volume attachment record: 42be894f-aa65-47b1-92df-68d0551d34f0 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:03:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:38 user nova-compute[74646]: INFO nova.compute.manager [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Detaching volume f04279dd-58aa-4c4c-a66c-2b2169de4886
Oct 26 16:03:38 user nova-compute[74646]: INFO nova.virt.block_device [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Attempting to driver detach volume f04279dd-58aa-4c4c-a66c-2b2169de4886 from mountpoint /dev/vdb
Oct 26 16:03:38 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Attempting to detach device vdb from instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:03:38 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:03:38 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:03:38 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:03:38 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:03:38 user nova-compute[74646]:   <serial>f04279dd-58aa-4c4c-a66c-2b2169de4886</serial>
Oct 26 16:03:38 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:03:38 user nova-compute[74646]: </disk>
Oct 26 16:03:38 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:03:38 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Successfully detached device vdb from instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 from the persistent domain config.
Oct 26 16:03:38 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:03:38 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:03:38 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:03:38 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:03:38 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:03:38 user nova-compute[74646]:   <serial>f04279dd-58aa-4c4c-a66c-2b2169de4886</serial>
Oct 26 16:03:38 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:03:38 user nova-compute[74646]: </disk>
Oct 26 16:03:38 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:03:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:03:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:03:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:52 user nova-compute[74646]: INFO nova.compute.manager [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Rescuing
Oct 26 16:03:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:03:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquired lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:03:52 user nova-compute[74646]: DEBUG nova.network.neutron [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:03:52 user nova-compute[74646]: DEBUG nova.network.neutron [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Updating instance_info_cache with network_info: [{"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:03:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Releasing lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:03:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:53 user nova-compute[74646]: DEBUG nova.compute.manager [req-a94b12ee-1eeb-457e-b88e-7e02c97c4be7 req-5d94c455-5d86-4b97-b1a1-e762aea871c7 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-vif-unplugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:03:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a94b12ee-1eeb-457e-b88e-7e02c97c4be7 req-5d94c455-5d86-4b97-b1a1-e762aea871c7 service nova] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a94b12ee-1eeb-457e-b88e-7e02c97c4be7 req-5d94c455-5d86-4b97-b1a1-e762aea871c7 service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a94b12ee-1eeb-457e-b88e-7e02c97c4be7 req-5d94c455-5d86-4b97-b1a1-e762aea871c7 service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:53 user nova-compute[74646]: DEBUG nova.compute.manager [req-a94b12ee-1eeb-457e-b88e-7e02c97c4be7 req-5d94c455-5d86-4b97-b1a1-e762aea871c7 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] No waiting events found dispatching network-vif-unplugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:03:53 user nova-compute[74646]: WARNING nova.compute.manager [req-a94b12ee-1eeb-457e-b88e-7e02c97c4be7 req-5d94c455-5d86-4b97-b1a1-e762aea871c7 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received unexpected event network-vif-unplugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 for instance with vm_state active and task_state rescuing.
Oct 26 16:03:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:53 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Instance destroyed successfully.
Oct 26 16:03:53 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Attempting a stable device rescue
Oct 26 16:03:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74646) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 16:03:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Instance directory exists: not creating {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 16:03:53 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Creating image(s)
Oct 26 16:03:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "/opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "/opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:53 user nova-compute[74646]: DEBUG nova.objects.instance [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'trusted_certs' on Instance uuid fa8813a4-be8c-452a-8d2d-a5fd972c2498 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:03:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "37135b453091cb7637120a7c258c36954115c219" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "37135b453091cb7637120a7c258c36954115c219" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37135b453091cb7637120a7c258c36954115c219.part --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-5ef109cb-429e-40ad-8c08-13f4d0d9a214 req-821b870e-4c4b-40e4-bc59-9ca16e26d7be service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:03:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5ef109cb-429e-40ad-8c08-13f4d0d9a214 req-821b870e-4c4b-40e4-bc59-9ca16e26d7be service nova] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5ef109cb-429e-40ad-8c08-13f4d0d9a214 req-821b870e-4c4b-40e4-bc59-9ca16e26d7be service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5ef109cb-429e-40ad-8c08-13f4d0d9a214 req-821b870e-4c4b-40e4-bc59-9ca16e26d7be service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-5ef109cb-429e-40ad-8c08-13f4d0d9a214 req-821b870e-4c4b-40e4-bc59-9ca16e26d7be service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] No waiting events found dispatching network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:03:55 user nova-compute[74646]: WARNING nova.compute.manager [req-5ef109cb-429e-40ad-8c08-13f4d0d9a214 req-821b870e-4c4b-40e4-bc59-9ca16e26d7be service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received unexpected event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 for instance with vm_state active and task_state rescuing.
Oct 26 16:03:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37135b453091cb7637120a7c258c36954115c219.part --force-share --output=json" returned: 0 in 0.200s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:55 user nova-compute[74646]: DEBUG nova.virt.images [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] a89e761d-bd21-4c76-b7aa-176502b8271a was qcow2, converting to raw {{(pid=74646) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 16:03:55 user nova-compute[74646]: DEBUG nova.privsep.utils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74646) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 16:03:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/37135b453091cb7637120a7c258c36954115c219.part /opt/stack/data/nova/instances/_base/37135b453091cb7637120a7c258c36954115c219.converted {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/37135b453091cb7637120a7c258c36954115c219.part /opt/stack/data/nova/instances/_base/37135b453091cb7637120a7c258c36954115c219.converted" returned: 0 in 0.465s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37135b453091cb7637120a7c258c36954115c219.converted --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37135b453091cb7637120a7c258c36954115c219.converted --force-share --output=json" returned: 0 in 0.218s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "37135b453091cb7637120a7c258c36954115c219" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.294s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "37135b453091cb7637120a7c258c36954115c219" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "37135b453091cb7637120a7c258c36954115c219" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37135b453091cb7637120a7c258c36954115c219 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37135b453091cb7637120a7c258c36954115c219 --force-share --output=json" returned: 0 in 0.187s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37135b453091cb7637120a7c258c36954115c219,backing_fmt=raw /opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/disk.rescue {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37135b453091cb7637120a7c258c36954115c219,backing_fmt=raw /opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/disk.rescue" returned: 0 in 0.052s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "37135b453091cb7637120a7c258c36954115c219" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.247s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.objects.instance [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'migration_context' on Instance uuid fa8813a4-be8c-452a-8d2d-a5fd972c2498 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.objects.base [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Object Instance<fa8813a4-be8c-452a-8d2d-a5fd972c2498> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Start _get_guest_xml network_info=[{"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "vif_mac": "fa:16:3e:05:f0:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a89e761d-bd21-4c76-b7aa-176502b8271a', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'cf291692-1c4c-430e-b864-52670788654a', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLeTDFiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'fa8813a4-be8c-452a-8d2d-a5fd972c2498', 'attached_at': '', 'detached_at': '', 'volume_id': '6e9aa5f9-c63b-4493-b887-bc5455f9dee2', 'serial': '6e9aa5f9-c63b-4493-b887-bc5455f9dee2'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.objects.instance [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'resources' on Instance uuid fa8813a4-be8c-452a-8d2d-a5fd972c2498 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.objects.base [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Object Instance<fa8813a4-be8c-452a-8d2d-a5fd972c2498> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.objects.instance [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'numa_topology' on Instance uuid fa8813a4-be8c-452a-8d2d-a5fd972c2498 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.objects.base [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Object Instance<fa8813a4-be8c-452a-8d2d-a5fd972c2498> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:56 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:03:56 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.objects.instance [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'vcpu_model' on Instance uuid fa8813a4-be8c-452a-8d2d-a5fd972c2498 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.objects.base [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Object Instance<fa8813a4-be8c-452a-8d2d-a5fd972c2498> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLeTDFiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:03:56 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:03:56 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:03:56 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[24de5602-9966-491e-9a60-b3b8afb9db07]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ZLeTDFiQ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 16:03:56 user nova-compute[74646]: node.name = iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:03:56 user nova-compute[74646]: node.tpgt = -1
Oct 26 16:03:56 user nova-compute[74646]: node.startup = automatic
Oct 26 16:03:56 user nova-compute[74646]: node.leading_login = No
Oct 26 16:03:56 user nova-compute[74646]: iface.iscsi_ifacename = default
Oct 26 16:03:56 user nova-compute[74646]: iface.net_ifacename = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.ipaddress = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.prefix_len = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.hwaddress = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.transport_name = tcp
Oct 26 16:03:56 user nova-compute[74646]: iface.initiatorname = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.state = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.vlan_id = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.vlan_priority = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.vlan_state = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.iface_num = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.mtu = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.port = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.bootproto = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.subnet_mask = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.gateway = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.dhcp_alt_client_id = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.dhcp_dns = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.dhcp_learn_iqn = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.dhcp_vendor_id_state = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.dhcp_vendor_id = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.dhcp_slp_da = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.fragmentation = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.gratuitous_arp = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.incoming_forwarding = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.tos_state = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.tos = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.ttl = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.delayed_ack = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.tcp_nagle = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.tcp_wsf_state = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.tcp_wsf = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.tcp_timer_scale = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.tcp_timestamp = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.redirect = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.def_task_mgmt_timeout = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.header_digest = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.data_digest = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.immediate_data = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.initial_r2t = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.data_seq_inorder = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.data_pdu_inorder = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.erl = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.max_receive_data_len = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.first_burst_len = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.max_outstanding_r2t = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.max_burst_len = 0
Oct 26 16:03:56 user nova-compute[74646]: iface.chap_auth = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.bidi_chap = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.strict_login_compliance = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.discovery_auth = <empty>
Oct 26 16:03:56 user nova-compute[74646]: iface.discovery_logout = <empty>
Oct 26 16:03:56 user nova-compute[74646]: node.discovery_address = <empty>
Oct 26 16:03:56 user nova-compute[74646]: node.discovery_port = 0
Oct 26 16:03:56 user nova-compute[74646]: node.discovery_type = static
Oct 26 16:03:56 user nova-compute[74646]: node.session.initial_cmdsn = 0
Oct 26 16:03:56 user nova-compute[74646]: node.session.initial_login_retry_max = 8
Oct 26 16:03:56 user nova-compute[74646]: node.session.xmit_thread_priority = -20
Oct 26 16:03:56 user nova-compute[74646]: node.session.cmds_max = 128
Oct 26 16:03:56 user nova-compute[74646]: node.session.queue_depth = 32
Oct 26 16:03:56 user nova-compute[74646]: node.session.nr_sessions = 1
Oct 26 16:03:56 user nova-compute[74646]: node.session.auth.authmethod = CHAP
Oct 26 16:03:56 user nova-compute[74646]: node.session.auth.username = ZLeTDFiQ
Oct 26 16:03:56 user nova-compute[74646]: node.session.auth.password = ***
Oct 26 16:03:56 user nova-compute[74646]: node.session.auth.username_in = <empty>
Oct 26 16:03:56 user nova-compute[74646]: node.session.auth.password_in = <empty>
Oct 26 16:03:56 user nova-compute[74646]: node.session.auth.chap_algs = MD5
Oct 26 16:03:56 user nova-compute[74646]: node.session.timeo.replacement_timeout = 120
Oct 26 16:03:56 user nova-compute[74646]: node.session.err_timeo.abort_timeout = 15
Oct 26 16:03:56 user nova-compute[74646]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 16:03:56 user nova-compute[74646]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 16:03:56 user nova-compute[74646]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 16:03:56 user nova-compute[74646]: node.session.iscsi.FastAbort = Yes
Oct 26 16:03:56 user nova-compute[74646]: node.session.iscsi.InitialR2T = No
Oct 26 16:03:56 user nova-compute[74646]: node.session.iscsi.ImmediateData = Yes
Oct 26 16:03:56 user nova-compute[74646]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 16:03:56 user nova-compute[74646]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 16:03:56 user nova-compute[74646]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 16:03:56 user nova-compute[74646]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 16:03:56 user nova-compute[74646]: node.session.iscsi.MaxConnections = 1
Oct 26 16:03:56 user nova-compute[74646]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 16:03:56 user nova-compute[74646]: node.session.iscsi.ERL = 0
Oct 26 16:03:56 user nova-compute[74646]: node.session.scan = manual
Oct 26 16:03:56 user nova-compute[74646]: node.session.reopen_max = 0
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].address = 172.16.0.220
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].port = 3260
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].startup = manual
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].tcp.window_size = 524288
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].tcp.type_of_service = 0
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].timeo.logout_timeout = 15
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].timeo.login_timeout = 15
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].timeo.auth_timeout = 45
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].iscsi.DataDigest = None
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].iscsi.IFMarker = No
Oct 26 16:03:56 user nova-compute[74646]: node.conn[0].iscsi.OFMarker = No
Oct 26 16:03:56 user nova-compute[74646]: # END RECORD
Oct 26 16:03:56 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff000d5d-c973-4d83-8521-011c0340d676]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[101a751d-7675-4d6b-a2e7-2482100a540b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLeTDFiQ {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZLeTDFiQ" returned: 0 in 0.030s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed22e9f-b1cb-4f2f-bb82-26c751fb2e95]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZLeTDFiQ'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ad3f7a-f9b6-4bee-b267-1f121d6ff124]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f979a7fc-cd17-4dcc-abeb-6039de0d19c9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:03:56 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:03:56 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:03:56 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:03:56 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:03:56 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:03:56 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:03:56 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:03:56 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:03:56 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:03:56 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:03:56 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:03:56 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.178s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] HCTL ('36', '0', '0', 0) found on session 27 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0342d19-98f6-4bcf-b067-5091633b6264]: (4, ('0 0 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching for a device in session 27 and hctl ('36', '0', '0', 0) yield: sde {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLeTDFiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.205s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] <== connect_volume: return (206ms) {'type': 'block', 'scsi_wwn': '23033633561396133', 'path': '/dev/sde'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033633561396133', 'path': '/dev/sde'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-946523720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-946523720',id=25,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:02:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90e848952345455183c15fee816b6f12',ramdisk_id='',reservation_id='r-qkm6r2ju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-580785668',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:02:23Z,user_data=None,user_id='abd7a869c235467ca4da99867c6bc0d4',uuid=fa8813a4-be8c-452a-8d2d-a5fd972c2498,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "vif_mac": "fa:16:3e:05:f0:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converting VIF {"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "vif_mac": "fa:16:3e:05:f0:c8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:f0:c8,bridge_name='br-int',has_traffic_filtering=True,id=a15cdcab-84af-42b2-bf76-a1c3027ee207,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cdcab-84') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.objects.instance [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'pci_devices' on Instance uuid fa8813a4-be8c-452a-8d2d-a5fd972c2498 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.objects.base [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Object Instance<fa8813a4-be8c-452a-8d2d-a5fd972c2498> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:03:56 user nova-compute[74646]:   <uuid>fa8813a4-be8c-452a-8d2d-a5fd972c2498</uuid>
Oct 26 16:03:56 user nova-compute[74646]:   <name>instance-00000019</name>
Oct 26 16:03:56 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:03:56 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:03:56 user nova-compute[74646]:   <metadata>
Oct 26 16:03:56 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:03:56 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:03:56 user nova-compute[74646]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-946523720</nova:name>
Oct 26 16:03:56 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:03:56</nova:creationTime>
Oct 26 16:03:56 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:03:56 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:03:56 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:03:56 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:03:56 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:03:56 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:03:56 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:03:56 user nova-compute[74646]:       <nova:owner>
Oct 26 16:03:56 user nova-compute[74646]:         <nova:user uuid="abd7a869c235467ca4da99867c6bc0d4">tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member</nova:user>
Oct 26 16:03:56 user nova-compute[74646]:         <nova:project uuid="90e848952345455183c15fee816b6f12">tempest-ServerBootFromVolumeStableRescueTest-580785668</nova:project>
Oct 26 16:03:56 user nova-compute[74646]:       </nova:owner>
Oct 26 16:03:56 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:03:56 user nova-compute[74646]:       <nova:ports>
Oct 26 16:03:56 user nova-compute[74646]:         <nova:port uuid="a15cdcab-84af-42b2-bf76-a1c3027ee207">
Oct 26 16:03:56 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 16:03:56 user nova-compute[74646]:         </nova:port>
Oct 26 16:03:56 user nova-compute[74646]:       </nova:ports>
Oct 26 16:03:56 user nova-compute[74646]:     </nova:instance>
Oct 26 16:03:56 user nova-compute[74646]:   </metadata>
Oct 26 16:03:56 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:03:56 user nova-compute[74646]:     <system>
Oct 26 16:03:56 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:03:56 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:03:56 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:03:56 user nova-compute[74646]:       <entry name="serial">fa8813a4-be8c-452a-8d2d-a5fd972c2498</entry>
Oct 26 16:03:56 user nova-compute[74646]:       <entry name="uuid">fa8813a4-be8c-452a-8d2d-a5fd972c2498</entry>
Oct 26 16:03:56 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:03:56 user nova-compute[74646]:     </system>
Oct 26 16:03:56 user nova-compute[74646]:   </sysinfo>
Oct 26 16:03:56 user nova-compute[74646]:   <os>
Oct 26 16:03:56 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:03:56 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:03:56 user nova-compute[74646]:   </os>
Oct 26 16:03:56 user nova-compute[74646]:   <features>
Oct 26 16:03:56 user nova-compute[74646]:     <acpi/>
Oct 26 16:03:56 user nova-compute[74646]:     <apic/>
Oct 26 16:03:56 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:03:56 user nova-compute[74646]:   </features>
Oct 26 16:03:56 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:03:56 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:03:56 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:03:56 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:03:56 user nova-compute[74646]:   </clock>
Oct 26 16:03:56 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:03:56 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:03:56 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:03:56 user nova-compute[74646]:   </cpu>
Oct 26 16:03:56 user nova-compute[74646]:   <devices>
Oct 26 16:03:56 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:03:56 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:03:56 user nova-compute[74646]:       <source dev="/dev/sde"/>
Oct 26 16:03:56 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:03:56 user nova-compute[74646]:       <serial>6e9aa5f9-c63b-4493-b887-bc5455f9dee2</serial>
Oct 26 16:03:56 user nova-compute[74646]:     </disk>
Oct 26 16:03:56 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:03:56 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:03:56 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/disk.rescue"/>
Oct 26 16:03:56 user nova-compute[74646]:       <target dev="vdb" bus="virtio"/>
Oct 26 16:03:56 user nova-compute[74646]:       <boot order="1"/>
Oct 26 16:03:56 user nova-compute[74646]:     </disk>
Oct 26 16:03:56 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:03:56 user nova-compute[74646]:       <mac address="fa:16:3e:05:f0:c8"/>
Oct 26 16:03:56 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:03:56 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:03:56 user nova-compute[74646]:       <target dev="tapa15cdcab-84"/>
Oct 26 16:03:56 user nova-compute[74646]:     </interface>
Oct 26 16:03:56 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:03:56 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/console.log" append="off"/>
Oct 26 16:03:56 user nova-compute[74646]:     </serial>
Oct 26 16:03:56 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:03:56 user nova-compute[74646]:     <video>
Oct 26 16:03:56 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:03:56 user nova-compute[74646]:     </video>
Oct 26 16:03:56 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:03:56 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:03:56 user nova-compute[74646]:     </rng>
Oct 26 16:03:56 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:03:56 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:03:56 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:03:56 user nova-compute[74646]:     </memballoon>
Oct 26 16:03:56 user nova-compute[74646]:   </devices>
Oct 26 16:03:56 user nova-compute[74646]: </domain>
Oct 26 16:03:56 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:03:56 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Instance destroyed successfully.
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:03:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] No VIF found with MAC fa:16:3e:05:f0:c8, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:03:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-e73d7674-b451-40ef-b258-528c90ae06e9 req-a7c6a3b0-4370-447a-93bb-483cc04b217f service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:03:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e73d7674-b451-40ef-b258-528c90ae06e9 req-a7c6a3b0-4370-447a-93bb-483cc04b217f service nova] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:03:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e73d7674-b451-40ef-b258-528c90ae06e9 req-a7c6a3b0-4370-447a-93bb-483cc04b217f service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:03:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e73d7674-b451-40ef-b258-528c90ae06e9 req-a7c6a3b0-4370-447a-93bb-483cc04b217f service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:03:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-e73d7674-b451-40ef-b258-528c90ae06e9 req-a7c6a3b0-4370-447a-93bb-483cc04b217f service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] No waiting events found dispatching network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:03:58 user nova-compute[74646]: WARNING nova.compute.manager [req-e73d7674-b451-40ef-b258-528c90ae06e9 req-a7c6a3b0-4370-447a-93bb-483cc04b217f service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received unexpected event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 for instance with vm_state active and task_state rescuing.
Oct 26 16:03:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:03:59 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 is timed out.
Oct 26 16:03:59 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Successfully detached device vdb from instance 2bae2991-6c17-4d79-9dd8-1fc69322f830 from the live domain config.
Oct 26 16:03:59 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cpUFDGbd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:03:59 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7412ab8a-1248-4123-ad45-950950488328]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:03:59 user nova-compute[74646]: No targets found.
Oct 26 16:03:59 user nova-compute[74646]: iSNS:
Oct 26 16:03:59 user nova-compute[74646]: No targets found.
Oct 26 16:03:59 user nova-compute[74646]: STATIC:
Oct 26 16:03:59 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c
Oct 26 16:03:59 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:59 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:59 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a
Oct 26 16:03:59 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:59 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:59 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886
Oct 26 16:03:59 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:59 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:59 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:03:59 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:59 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:59 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335
Oct 26 16:03:59 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:59 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:59 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509
Oct 26 16:03:59 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:03:59 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:03:59 user nova-compute[74646]: FIRMWARE:
Oct 26 16:03:59 user nova-compute[74646]: No targets found.
Oct 26 16:03:59 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:03:59 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:03:59 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[41746ef6-4f3b-4490-8d65-1d1ecb97892c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd1d2ab-a52b-4414-bdde-cc75d8616b61]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:03:59 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:03:59 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:03:59 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:03:59 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:03:59 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:03:59 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:03:59 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:03:59 user nova-compute[74646]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 (non-flash)
Oct 26 16:03:59 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:03:59 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:03:59 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:03:59 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d05b3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886'): ({'sdd'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Removing single pathed devices sdd {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ea9d58-2022-4795-a928-b0f69ee8923d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ce1a87-de5e-40de-bdd3-25da0162db9e]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Flushing IO for device /dev/sdd {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a5d22d-568b-431c-8919-a67197cbb86e]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca99d8c6-0cef-4d6e-b793-2bbd36eb18f7]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[66600643-30e9-49c4-8548-70473f208efa]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c634663-e1ae-4e69-9398-520f5404eebb]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886, portal: 172.16.0.220,3260]
Oct 26 16:03:59 user nova-compute[74646]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886, portal: 172.16.0.220,3260] successful.
Oct 26 16:03:59 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f04279dd-58aa-4c4c-a66c-2b2169de4886 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6771b83a-0528-4622-8762-f728a847eb8c]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] <== disconnect_volume: return (330ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:03:59 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:04:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-217ea4df-5de4-4002-afb5-97bd69b8d9c0 req-77824690-de8c-40f2-ac58-26ab09f3d75c service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-217ea4df-5de4-4002-afb5-97bd69b8d9c0 req-77824690-de8c-40f2-ac58-26ab09f3d75c service nova] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-217ea4df-5de4-4002-afb5-97bd69b8d9c0 req-77824690-de8c-40f2-ac58-26ab09f3d75c service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-217ea4df-5de4-4002-afb5-97bd69b8d9c0 req-77824690-de8c-40f2-ac58-26ab09f3d75c service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-217ea4df-5de4-4002-afb5-97bd69b8d9c0 req-77824690-de8c-40f2-ac58-26ab09f3d75c service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] No waiting events found dispatching network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:00 user nova-compute[74646]: WARNING nova.compute.manager [req-217ea4df-5de4-4002-afb5-97bd69b8d9c0 req-77824690-de8c-40f2-ac58-26ab09f3d75c service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received unexpected event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 for instance with vm_state active and task_state rescuing.
Oct 26 16:04:00 user nova-compute[74646]: DEBUG nova.compute.manager [None req-fcbbbd52-2bb1-4fbc-9496-fe6b00ac359f tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:04:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG nova.objects.instance [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lazy-loading 'flavor' on Instance uuid 2bae2991-6c17-4d79-9dd8-1fc69322f830 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-9bf147c9-5db2-46fd-a864-b0d22a1eb98f tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.589s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HMFmZjwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:04:08 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:04:08 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:04:08 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2d19c7-e28f-4844-bd91-1b1423259aa5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:04:08 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e438329-d587-4919-97ec-c619accbcb5b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c] added
Oct 26 16:04:08 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49bdc4a-24c7-4754-bb66-1665591b2bd5]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5764dd57-af95-46f1-b79e-b1db86aab661]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HMFmZjwo {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HMFmZjwo" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[31deea26-0bca-4c3e-bfec-df063a480769]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HMFmZjwo'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d163b552-b5e5-4fbc-b6f1-a86a84d8f543]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bea7b0-75e6-4f87-84f6-9fa0a6c5ce82]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:04:08 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:04:08 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[af98922f-7bd8-4971-a270-b820813129a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c, portal: 172.16.0.220,3260]
Oct 26 16:04:08 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c, portal: 172.16.0.220,3260] successful.
Oct 26 16:04:08 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5d40fb-0cc7-47a8-8753-2258be1eb899]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5141d4ad-6425-4e33-8995-b8f24d8d3099]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c (non-flash)
Oct 26 16:04:08 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:04:08 user nova-compute[74646]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c (non-flash)
Oct 26 16:04:08 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ea36aa-4fa0-425b-b953-66e6368437c6]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:04:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HMFmZjwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:04:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:04:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23937383362343636', 'path': '/dev/sdd'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:04:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937383362343636', 'path': '/dev/sdd'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:04:09 user nova-compute[74646]: DEBUG nova.objects.instance [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lazy-loading 'flavor' on Instance uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:04:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:04:09 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:04:09 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:04:09 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:04:09 user nova-compute[74646]:   <serial>998293e6-dd21-44fb-ac03-31edff3e383c</serial>
Oct 26 16:04:09 user nova-compute[74646]: </disk>
Oct 26 16:04:09 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:04:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:04:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:04:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] No VIF found with MAC fa:16:3e:cc:b0:d3, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:04:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-51ef645e-c5bd-4232-9487-8239f05e62df tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 34.964s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:11 user nova-compute[74646]: INFO nova.compute.manager [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Detaching volume f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a
Oct 26 16:04:11 user nova-compute[74646]: INFO nova.virt.block_device [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Attempting to driver detach volume f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a from mountpoint /dev/vdb
Oct 26 16:04:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Attempting to detach device vdb from instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:04:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:04:11 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:04:11 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 16:04:11 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:04:11 user nova-compute[74646]:   <serial>f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a</serial>
Oct 26 16:04:11 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 16:04:11 user nova-compute[74646]: </disk>
Oct 26 16:04:11 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:04:11 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Successfully detached device vdb from instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de from the persistent domain config.
Oct 26 16:04:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:04:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:04:11 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:04:11 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 16:04:11 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:04:11 user nova-compute[74646]:   <serial>f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a</serial>
Oct 26 16:04:11 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 26 16:04:11 user nova-compute[74646]: </disk>
Oct 26 16:04:11 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:04:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:04:12 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:04:12 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Cleaning up deleted instances {{(pid=74646) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 16:04:12 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] There are 0 instances to clean {{(pid=74646) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 16:04:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:12 user nova-compute[74646]: INFO nova.compute.manager [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Detaching volume 998293e6-dd21-44fb-ac03-31edff3e383c
Oct 26 16:04:13 user nova-compute[74646]: INFO nova.virt.block_device [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Attempting to driver detach volume 998293e6-dd21-44fb-ac03-31edff3e383c from mountpoint /dev/vdb
Oct 26 16:04:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Attempting to detach device vdb from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:04:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:04:13 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:04:13 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:04:13 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:04:13 user nova-compute[74646]:   <serial>998293e6-dd21-44fb-ac03-31edff3e383c</serial>
Oct 26 16:04:13 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:04:13 user nova-compute[74646]: </disk>
Oct 26 16:04:13 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:04:13 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Successfully detached device vdb from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the persistent domain config.
Oct 26 16:04:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:04:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:04:13 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:04:13 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:04:13 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:04:13 user nova-compute[74646]:   <serial>998293e6-dd21-44fb-ac03-31edff3e383c</serial>
Oct 26 16:04:13 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:04:13 user nova-compute[74646]: </disk>
Oct 26 16:04:13 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:04:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:04:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:04:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:15 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:04:15 user nova-compute[74646]: INFO nova.compute.claims [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Claim successful on node user
Oct 26 16:04:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:16 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:04:16 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:04:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:16 user nova-compute[74646]: DEBUG nova.compute.manager [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:04:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:16 user nova-compute[74646]: DEBUG nova.compute.manager [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:04:16 user nova-compute[74646]: DEBUG nova.network.neutron [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:04:16 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:04:16 user nova-compute[74646]: DEBUG nova.compute.manager [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:04:16 user nova-compute[74646]: DEBUG nova.policy [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e00e398f6dc344f4afaa44c119f87f2b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e982f0135534a22ba32bb089b85d3f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:04:16 user nova-compute[74646]: DEBUG nova.compute.manager [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:04:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:04:16 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Creating image(s)
Oct 26 16:04:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "/opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "/opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "/opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f.part --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG nova.network.neutron [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Successfully created port: 54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG nova.virt.images [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] dce153f2-3afa-4add-885e-d08e1a98449b was qcow2, converting to raw {{(pid=74646) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG nova.privsep.utils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74646) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f.part /opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f.converted {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:17 user nova-compute[74646]: INFO nova.compute.manager [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Terminating instance
Oct 26 16:04:17 user nova-compute[74646]: DEBUG nova.compute.manager [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f.part /opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f.converted" returned: 0 in 0.390s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f.converted --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.239s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-d0bb0590-f949-40ce-a3bd-4627ca250ddd req-e46c9615-dce0-40b1-a84e-6541703637ca service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Received event network-vif-unplugged-dfeef6e7-4c83-488b-8665-ba2df944d509 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d0bb0590-f949-40ce-a3bd-4627ca250ddd req-e46c9615-dce0-40b1-a84e-6541703637ca service nova] Acquiring lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d0bb0590-f949-40ce-a3bd-4627ca250ddd req-e46c9615-dce0-40b1-a84e-6541703637ca service nova] Lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d0bb0590-f949-40ce-a3bd-4627ca250ddd req-e46c9615-dce0-40b1-a84e-6541703637ca service nova] Lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-d0bb0590-f949-40ce-a3bd-4627ca250ddd req-e46c9615-dce0-40b1-a84e-6541703637ca service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] No waiting events found dispatching network-vif-unplugged-dfeef6e7-4c83-488b-8665-ba2df944d509 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-d0bb0590-f949-40ce-a3bd-4627ca250ddd req-e46c9615-dce0-40b1-a84e-6541703637ca service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Received event network-vif-unplugged-dfeef6e7-4c83-488b-8665-ba2df944d509 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f --force-share --output=json" returned: 0 in 0.197s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:18 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Instance destroyed successfully.
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.objects.instance [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lazy-loading 'resources' on Instance uuid 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:02:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2064777453',display_name='tempest-TestVolumeBootPattern-server-2064777453',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2064777453',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:03:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-v6tle7uk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:03:01Z,user_data=None,user_id='9419f9603ca647269ed1cf42e233507f',uuid=4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dfeef6e7-4c83-488b-8665-ba2df944d509", "address": "fa:16:3e:3e:f5:9d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfeef6e7-4c", "ovs_interfaceid": "dfeef6e7-4c83-488b-8665-ba2df944d509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "dfeef6e7-4c83-488b-8665-ba2df944d509", "address": "fa:16:3e:3e:f5:9d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdfeef6e7-4c", "ovs_interfaceid": "dfeef6e7-4c83-488b-8665-ba2df944d509", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f5:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfeef6e7-4c83-488b-8665-ba2df944d509,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfeef6e7-4c') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_vif [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f5:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfeef6e7-4c83-488b-8665-ba2df944d509,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfeef6e7-4c') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdfeef6e7-4c, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7598fde-de92-42a7-ae48-7add4eea56e1) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:18 user nova-compute[74646]: INFO os_vif [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:f5:9d,bridge_name='br-int',has_traffic_filtering=True,id=dfeef6e7-4c83-488b-8665-ba2df944d509,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdfeef6e7-4c')
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uphGitOl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:04:18 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f --force-share --output=json" returned: 0 in 0.206s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f,backing_fmt=raw /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a161186-dc79-4b6f-b931-0feeef0b9ad6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:04:18 user nova-compute[74646]: No targets found.
Oct 26 16:04:18 user nova-compute[74646]: iSNS:
Oct 26 16:04:18 user nova-compute[74646]: No targets found.
Oct 26 16:04:18 user nova-compute[74646]: STATIC:
Oct 26 16:04:18 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c
Oct 26 16:04:18 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:18 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:18 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a
Oct 26 16:04:18 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:18 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:18 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:04:18 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:18 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:18 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c
Oct 26 16:04:18 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:18 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:18 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335
Oct 26 16:04:18 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:18 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:18 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509
Oct 26 16:04:18 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:18 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:18 user nova-compute[74646]: FIRMWARE:
Oct 26 16:04:18 user nova-compute[74646]: No targets found.
Oct 26 16:04:18 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:04:18 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:04:18 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f,backing_fmt=raw /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk 1073741824" returned: 0 in 0.059s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[253585a8-0d02-4ff6-bf28-37c29c409b42]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.043s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cb0b4f0-941c-4c25-9475-1ca43f36a532]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:04:18 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:04:18 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:18 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:04:18 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:04:18 user nova-compute[74646]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c (non-flash)
Oct 26 16:04:18 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:04:18 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:04:18 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:18 user nova-compute[74646]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c (non-flash)
Oct 26 16:04:18 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:04:18 user nova-compute[74646]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c (non-flash)
Oct 26 16:04:18 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d05e8670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c'): ({'sdh'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Removing single pathed devices sdh {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.network.neutron [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Successfully updated port: 54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c64581d4-4a1d-4627-a17b-5d2e773c5512]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquired lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.network.neutron [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[03af0857-29c8-448e-812a-9f47a9a63b87]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flushing IO for device /dev/sdh {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[956dd791-2a0b-43cd-af9a-8ee2612c55d5]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/79277dfbc3cc86d3fbdfe2550b2dd0e471972a7f --force-share --output=json" returned: 0 in 0.203s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Checking if we can resize image /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.network.neutron [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.040s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a9d5b2-c2b9-435d-83ad-275f188a5467]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] SCSI volumes sdh have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7ddfd0a7-3ab5723c0895fade', '/dev/disk/by-id/scsi-23361623537323363', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7ddfd0a7') {{(pid=85624) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 16:04:18 user nova-compute[74646]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO7ddfd0a7-3ab5723c0895fade
Oct 26 16:04:18 user nova-compute[74646]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23361623537323363
Oct 26 16:04:18 user nova-compute[74646]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_7ddfd0a7
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[659f26ef-4891-4668-a7a2-371bf68c3438]: (4, None) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e47488-b4f4-4339-adf4-5abb69d83aba]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3b4ae2-5dcd-4843-8ccc-23abdb9f37f7]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c, portal: 172.16.0.220,3260]
Oct 26 16:04:18 user nova-compute[74646]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c, portal: 172.16.0.220,3260] successful.
Oct 26 16:04:18 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81e297b2-3f4c-47fb-8651-9e856d30201c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[345b06b9-4f80-407d-9cd6-dba5d60fd012]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.467s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== disconnect_volume: return (469ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:04:18 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Deleting instance files /opt/stack/data/nova/instances/4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f_del
Oct 26 16:04:18 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Deletion of /opt/stack/data/nova/instances/4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f_del complete
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Cannot resize image /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Ensure instance console log exists: /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:18 user nova-compute[74646]: INFO nova.compute.manager [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Took 1.42 seconds to destroy the instance on the hypervisor.
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.network.neutron [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Updating instance_info_cache with network_info: [{"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Releasing lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.compute.manager [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Instance network_info: |[{"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Start _get_guest_xml network_info=[{"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:04:12Z,direct_url=<?>,disk_format='qcow2',id=dce153f2-3afa-4add-885e-d08e1a98449b,min_disk=0,min_ram=0,name='tempest-scenario-img--1481209351',owner='0e982f0135534a22ba32bb089b85d3f3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:04:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': 'dce153f2-3afa-4add-885e-d08e1a98449b'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:04:18 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:04:18 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T16:04:12Z,direct_url=<?>,disk_format='qcow2',id=dce153f2-3afa-4add-885e-d08e1a98449b,min_disk=0,min_ram=0,name='tempest-scenario-img--1481209351',owner='0e982f0135534a22ba32bb089b85d3f3',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T16:04:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-163721245',display_name='tempest-TestMinimumBasicScenario-server-163721245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-163721245',id=29,image_ref='dce153f2-3afa-4add-885e-d08e1a98449b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD42axiQ6vuzg5vRgqQbfl7+rAMqHHcy8T+PuWjPAWv+N3NUiZBzREMB3lqxHQu6SmLTnm0f2W6skdla2Cme+AFtQpPdVm0qeCCk9Yg6xPTI2c8dsYU12YIrUzMvSlkeA==',key_name='tempest-TestMinimumBasicScenario-217858511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e982f0135534a22ba32bb089b85d3f3',ramdisk_id='',reservation_id='r-nynz53ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dce153f2-3afa-4add-885e-d08e1a98449b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1275819184',owner_user_name='tempest-TestMinimumBasicScenario-1275819184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:04:17Z,user_data=None,user_id='e00e398f6dc344f4afaa44c119f87f2b',uuid=670508e6-ee5a-4aa9-bb9a-a696205174b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Converting VIF {"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:55:01,bridge_name='br-int',has_traffic_filtering=True,id=54ef776d-25f3-4729-98c1-6ecc9029e55e,network=Network(771871f2-36c1-4cc5-aa99-b2687f67b96c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ef776d-25') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.objects.instance [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lazy-loading 'pci_devices' on Instance uuid 670508e6-ee5a-4aa9-bb9a-a696205174b8 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:04:18 user nova-compute[74646]:   <uuid>670508e6-ee5a-4aa9-bb9a-a696205174b8</uuid>
Oct 26 16:04:18 user nova-compute[74646]:   <name>instance-0000001d</name>
Oct 26 16:04:18 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:04:18 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:04:18 user nova-compute[74646]:   <metadata>
Oct 26 16:04:18 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:04:18 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:04:18 user nova-compute[74646]:       <nova:name>tempest-TestMinimumBasicScenario-server-163721245</nova:name>
Oct 26 16:04:18 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:04:18</nova:creationTime>
Oct 26 16:04:18 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:04:18 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:04:18 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:04:18 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:04:18 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:04:18 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:04:18 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:04:18 user nova-compute[74646]:       <nova:owner>
Oct 26 16:04:18 user nova-compute[74646]:         <nova:user uuid="e00e398f6dc344f4afaa44c119f87f2b">tempest-TestMinimumBasicScenario-1275819184-project-member</nova:user>
Oct 26 16:04:18 user nova-compute[74646]:         <nova:project uuid="0e982f0135534a22ba32bb089b85d3f3">tempest-TestMinimumBasicScenario-1275819184</nova:project>
Oct 26 16:04:18 user nova-compute[74646]:       </nova:owner>
Oct 26 16:04:18 user nova-compute[74646]:       <nova:root type="image" uuid="dce153f2-3afa-4add-885e-d08e1a98449b"/>
Oct 26 16:04:18 user nova-compute[74646]:       <nova:ports>
Oct 26 16:04:18 user nova-compute[74646]:         <nova:port uuid="54ef776d-25f3-4729-98c1-6ecc9029e55e">
Oct 26 16:04:18 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 26 16:04:18 user nova-compute[74646]:         </nova:port>
Oct 26 16:04:18 user nova-compute[74646]:       </nova:ports>
Oct 26 16:04:18 user nova-compute[74646]:     </nova:instance>
Oct 26 16:04:18 user nova-compute[74646]:   </metadata>
Oct 26 16:04:18 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:04:18 user nova-compute[74646]:     <system>
Oct 26 16:04:18 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:04:18 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:04:18 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:04:18 user nova-compute[74646]:       <entry name="serial">670508e6-ee5a-4aa9-bb9a-a696205174b8</entry>
Oct 26 16:04:18 user nova-compute[74646]:       <entry name="uuid">670508e6-ee5a-4aa9-bb9a-a696205174b8</entry>
Oct 26 16:04:18 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:04:18 user nova-compute[74646]:     </system>
Oct 26 16:04:18 user nova-compute[74646]:   </sysinfo>
Oct 26 16:04:18 user nova-compute[74646]:   <os>
Oct 26 16:04:18 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:04:18 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:04:18 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:04:18 user nova-compute[74646]:   </os>
Oct 26 16:04:18 user nova-compute[74646]:   <features>
Oct 26 16:04:18 user nova-compute[74646]:     <acpi/>
Oct 26 16:04:18 user nova-compute[74646]:     <apic/>
Oct 26 16:04:18 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:04:18 user nova-compute[74646]:   </features>
Oct 26 16:04:18 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:04:18 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:04:18 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:04:18 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:04:18 user nova-compute[74646]:   </clock>
Oct 26 16:04:18 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:04:18 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:04:18 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:04:18 user nova-compute[74646]:   </cpu>
Oct 26 16:04:18 user nova-compute[74646]:   <devices>
Oct 26 16:04:18 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:04:18 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:04:18 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk"/>
Oct 26 16:04:18 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:04:18 user nova-compute[74646]:     </disk>
Oct 26 16:04:18 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:04:18 user nova-compute[74646]:       <mac address="fa:16:3e:bf:55:01"/>
Oct 26 16:04:18 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:04:18 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:04:18 user nova-compute[74646]:       <target dev="tap54ef776d-25"/>
Oct 26 16:04:18 user nova-compute[74646]:     </interface>
Oct 26 16:04:18 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:04:18 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/console.log" append="off"/>
Oct 26 16:04:18 user nova-compute[74646]:     </serial>
Oct 26 16:04:18 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:04:18 user nova-compute[74646]:     <video>
Oct 26 16:04:18 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:04:18 user nova-compute[74646]:     </video>
Oct 26 16:04:18 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:04:18 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:04:18 user nova-compute[74646]:     </rng>
Oct 26 16:04:18 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:04:18 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:04:18 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:04:18 user nova-compute[74646]:     </memballoon>
Oct 26 16:04:18 user nova-compute[74646]:   </devices>
Oct 26 16:04:18 user nova-compute[74646]: </domain>
Oct 26 16:04:18 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-163721245',display_name='tempest-TestMinimumBasicScenario-server-163721245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-163721245',id=29,image_ref='dce153f2-3afa-4add-885e-d08e1a98449b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD42axiQ6vuzg5vRgqQbfl7+rAMqHHcy8T+PuWjPAWv+N3NUiZBzREMB3lqxHQu6SmLTnm0f2W6skdla2Cme+AFtQpPdVm0qeCCk9Yg6xPTI2c8dsYU12YIrUzMvSlkeA==',key_name='tempest-TestMinimumBasicScenario-217858511',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0e982f0135534a22ba32bb089b85d3f3',ramdisk_id='',reservation_id='r-nynz53ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dce153f2-3afa-4add-885e-d08e1a98449b',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1275819184',owner_user_name='tempest-TestMinimumBasicScenario-1275819184-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:04:17Z,user_data=None,user_id='e00e398f6dc344f4afaa44c119f87f2b',uuid=670508e6-ee5a-4aa9-bb9a-a696205174b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Converting VIF {"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:55:01,bridge_name='br-int',has_traffic_filtering=True,id=54ef776d-25f3-4729-98c1-6ecc9029e55e,network=Network(771871f2-36c1-4cc5-aa99-b2687f67b96c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ef776d-25') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG os_vif [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:55:01,bridge_name='br-int',has_traffic_filtering=True,id=54ef776d-25f3-4729-98c1-6ecc9029e55e,network=Network(771871f2-36c1-4cc5-aa99-b2687f67b96c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ef776d-25') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '26de7734-bf23-50e5-bc10-5132da38f86d', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap54ef776d-25, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap54ef776d-25, col_values=(('qos', UUID('0e621bbc-a18b-49e8-9808-9f8c171f39a3')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap54ef776d-25, col_values=(('external_ids', {'iface-id': '54ef776d-25f3-4729-98c1-6ecc9029e55e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:55:01', 'vm-uuid': '670508e6-ee5a-4aa9-bb9a-a696205174b8'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:04:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:04:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:19 user nova-compute[74646]: INFO os_vif [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:55:01,bridge_name='br-int',has_traffic_filtering=True,id=54ef776d-25f3-4729-98c1-6ecc9029e55e,network=Network(771871f2-36c1-4cc5-aa99-b2687f67b96c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ef776d-25')
Oct 26 16:04:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:04:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] No VIF found with MAC fa:16:3e:bf:55:01, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:04:19 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:04:19 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Took 0.47 seconds to deallocate network for instance.
Oct 26 16:04:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-c7e0f921-9e48-4ce7-9afd-f406a5ef2d6a req-f58d40d8-a247-493a-8aac-e21712f2611c service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Received event network-vif-deleted-dfeef6e7-4c83-488b-8665-ba2df944d509 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:19 user nova-compute[74646]: INFO nova.compute.manager [req-c7e0f921-9e48-4ce7-9afd-f406a5ef2d6a req-f58d40d8-a247-493a-8aac-e21712f2611c service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Neutron deleted interface dfeef6e7-4c83-488b-8665-ba2df944d509; detaching it from the instance and deleting it from the info cache
Oct 26 16:04:19 user nova-compute[74646]: DEBUG nova.network.neutron [req-c7e0f921-9e48-4ce7-9afd-f406a5ef2d6a req-f58d40d8-a247-493a-8aac-e21712f2611c service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:04:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-c7e0f921-9e48-4ce7-9afd-f406a5ef2d6a req-f58d40d8-a247-493a-8aac-e21712f2611c service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Detach interface failed, port_id=dfeef6e7-4c83-488b-8665-ba2df944d509, reason: Instance 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f could not be found. {{(pid=74646) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG nova.compute.manager [req-ca9035cb-9b2d-440d-8332-ea9b85aab97a req-55018931-6504-4b75-8174-81ada7a4e651 service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Received event network-vif-plugged-dfeef6e7-4c83-488b-8665-ba2df944d509 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ca9035cb-9b2d-440d-8332-ea9b85aab97a req-55018931-6504-4b75-8174-81ada7a4e651 service nova] Acquiring lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ca9035cb-9b2d-440d-8332-ea9b85aab97a req-55018931-6504-4b75-8174-81ada7a4e651 service nova] Lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ca9035cb-9b2d-440d-8332-ea9b85aab97a req-55018931-6504-4b75-8174-81ada7a4e651 service nova] Lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG nova.compute.manager [req-ca9035cb-9b2d-440d-8332-ea9b85aab97a req-55018931-6504-4b75-8174-81ada7a4e651 service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] No waiting events found dispatching network-vif-plugged-dfeef6e7-4c83-488b-8665-ba2df944d509 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:20 user nova-compute[74646]: WARNING nova.compute.manager [req-ca9035cb-9b2d-440d-8332-ea9b85aab97a req-55018931-6504-4b75-8174-81ada7a4e651 service nova] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Received unexpected event network-vif-plugged-dfeef6e7-4c83-488b-8665-ba2df944d509 for instance with vm_state active and task_state deleting.
Oct 26 16:04:20 user nova-compute[74646]: DEBUG nova.compute.manager [req-ca9035cb-9b2d-440d-8332-ea9b85aab97a req-55018931-6504-4b75-8174-81ada7a4e651 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-changed-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG nova.compute.manager [req-ca9035cb-9b2d-440d-8332-ea9b85aab97a req-55018931-6504-4b75-8174-81ada7a4e651 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Refreshing instance network info cache due to event network-changed-54ef776d-25f3-4729-98c1-6ecc9029e55e. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ca9035cb-9b2d-440d-8332-ea9b85aab97a req-55018931-6504-4b75-8174-81ada7a4e651 service nova] Acquiring lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ca9035cb-9b2d-440d-8332-ea9b85aab97a req-55018931-6504-4b75-8174-81ada7a4e651 service nova] Acquired lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG nova.network.neutron [req-ca9035cb-9b2d-440d-8332-ea9b85aab97a req-55018931-6504-4b75-8174-81ada7a4e651 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Refreshing network info cache for port 54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG nova.network.neutron [req-ca9035cb-9b2d-440d-8332-ea9b85aab97a req-55018931-6504-4b75-8174-81ada7a4e651 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Updated VIF entry in instance network info cache for port 54ef776d-25f3-4729-98c1-6ecc9029e55e. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG nova.network.neutron [req-ca9035cb-9b2d-440d-8332-ea9b85aab97a req-55018931-6504-4b75-8174-81ada7a4e651 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Updating instance_info_cache with network_info: [{"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ca9035cb-9b2d-440d-8332-ea9b85aab97a req-55018931-6504-4b75-8174-81ada7a4e651 service nova] Releasing lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:04:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-32c92055-af28-4a9c-96ee-0f7cd842f32d req-b389eebe-61e9-435a-91e4-1af68039d48c service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-32c92055-af28-4a9c-96ee-0f7cd842f32d req-b389eebe-61e9-435a-91e4-1af68039d48c service nova] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-32c92055-af28-4a9c-96ee-0f7cd842f32d req-b389eebe-61e9-435a-91e4-1af68039d48c service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-32c92055-af28-4a9c-96ee-0f7cd842f32d req-b389eebe-61e9-435a-91e4-1af68039d48c service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-32c92055-af28-4a9c-96ee-0f7cd842f32d req-b389eebe-61e9-435a-91e4-1af68039d48c service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] No waiting events found dispatching network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:21 user nova-compute[74646]: WARNING nova.compute.manager [req-32c92055-af28-4a9c-96ee-0f7cd842f32d req-b389eebe-61e9-435a-91e4-1af68039d48c service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received unexpected event network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e for instance with vm_state building and task_state spawning.
Oct 26 16:04:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-32c92055-af28-4a9c-96ee-0f7cd842f32d req-b389eebe-61e9-435a-91e4-1af68039d48c service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-32c92055-af28-4a9c-96ee-0f7cd842f32d req-b389eebe-61e9-435a-91e4-1af68039d48c service nova] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-32c92055-af28-4a9c-96ee-0f7cd842f32d req-b389eebe-61e9-435a-91e4-1af68039d48c service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-32c92055-af28-4a9c-96ee-0f7cd842f32d req-b389eebe-61e9-435a-91e4-1af68039d48c service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-32c92055-af28-4a9c-96ee-0f7cd842f32d req-b389eebe-61e9-435a-91e4-1af68039d48c service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] No waiting events found dispatching network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:21 user nova-compute[74646]: WARNING nova.compute.manager [req-32c92055-af28-4a9c-96ee-0f7cd842f32d req-b389eebe-61e9-435a-91e4-1af68039d48c service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received unexpected event network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e for instance with vm_state building and task_state spawning.
Oct 26 16:04:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:04:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:04:22 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Instance spawned successfully.
Oct 26 16:04:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:04:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:04:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:04:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:04:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:04:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:04:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:04:22 user nova-compute[74646]: INFO nova.compute.manager [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Took 6.11 seconds to spawn the instance on the hypervisor.
Oct 26 16:04:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:04:22 user nova-compute[74646]: INFO nova.compute.manager [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Took 6.95 seconds to build instance.
Oct 26 16:04:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-849e5610-0a73-4231-909d-9da36ee00f63 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.081s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:04:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:04:24 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:04:25 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:04:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:26 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:04:26 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:04:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:26 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:04:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:04:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/disk.rescue --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/disk.rescue --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:04:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:04:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:29 user nova-compute[74646]: INFO nova.compute.manager [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Terminating instance
Oct 26 16:04:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-22f495e3-a344-4e14-aee6-0e2474a3e385 req-3c3034ae-9dd7-452b-8f99-4a1010ae3c92 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received event network-vif-unplugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-22f495e3-a344-4e14-aee6-0e2474a3e385 req-3c3034ae-9dd7-452b-8f99-4a1010ae3c92 service nova] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-22f495e3-a344-4e14-aee6-0e2474a3e385 req-3c3034ae-9dd7-452b-8f99-4a1010ae3c92 service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-22f495e3-a344-4e14-aee6-0e2474a3e385 req-3c3034ae-9dd7-452b-8f99-4a1010ae3c92 service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-22f495e3-a344-4e14-aee6-0e2474a3e385 req-3c3034ae-9dd7-452b-8f99-4a1010ae3c92 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] No waiting events found dispatching network-vif-unplugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-22f495e3-a344-4e14-aee6-0e2474a3e385 req-3c3034ae-9dd7-452b-8f99-4a1010ae3c92 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received event network-vif-unplugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "cd751613-c043-4903-b45c-1f19dccb0acb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "cd751613-c043-4903-b45c-1f19dccb0acb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:29 user nova-compute[74646]: INFO nova.compute.manager [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Detaching volume 8f898821-3888-4bc8-9957-783fc1f36335
Oct 26 16:04:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:30 user nova-compute[74646]: INFO nova.virt.block_device [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Attempting to driver detach volume 8f898821-3888-4bc8-9957-783fc1f36335 from mountpoint /dev/vdb
Oct 26 16:04:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "cd751613-c043-4903-b45c-1f19dccb0acb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:30 user nova-compute[74646]: INFO nova.compute.manager [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Took 10.79 seconds to detach 1 volumes for instance.
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f] Deleting volume: 81e297b2-3f4c-47fb-8651-9e856d30201c {{(pid=74646) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Attempting to detach device vdb from instance cd751613-c043-4903-b45c-1f19dccb0acb from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:04:30 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:04:30 user nova-compute[74646]:   <source dev="/dev/sdf"/>
Oct 26 16:04:30 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:04:30 user nova-compute[74646]:   <serial>8f898821-3888-4bc8-9957-783fc1f36335</serial>
Oct 26 16:04:30 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:04:30 user nova-compute[74646]: </disk>
Oct 26 16:04:30 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:30 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Successfully detached device vdb from instance cd751613-c043-4903-b45c-1f19dccb0acb from the persistent domain config.
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd751613-c043-4903-b45c-1f19dccb0acb from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:04:30 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:04:30 user nova-compute[74646]:   <source dev="/dev/sdf"/>
Oct 26 16:04:30 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:04:30 user nova-compute[74646]:   <serial>8f898821-3888-4bc8-9957-783fc1f36335</serial>
Oct 26 16:04:30 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:04:30 user nova-compute[74646]: </disk>
Oct 26 16:04:30 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:30 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Instance destroyed successfully.
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.objects.instance [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lazy-loading 'resources' on Instance uuid 2bae2991-6c17-4d79-9dd8-1fc69322f830 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:00:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-253863828',display_name='tempest-TestServerVolumeAttachmentScenario-server-253863828',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-253863828',id=23,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjzskPLQo5nmWblINqcUhjBMPjk+v3fpkscYh6/tbCluMzdBjp385ici2hsILTrMk+gi1yJjPsTXSQhk1KNalBXCenVtJbHQ4GZH9kdnM/cgvlgLmn/8/JOrQ9TaFP1KQ==',key_name='tempest-keypair-1740650127',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:00:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='72016ef51af8410c88eb0deb826ae3ff',ramdisk_id='',reservation_id='r-cz0ne7jw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-352649452',owner_user_name='tempest-TestServerVolumeAttachmentScenario-352649452-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:00:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='36b0bfd61fb8451c8fea1b68075e2581',uuid=2bae2991-6c17-4d79-9dd8-1fc69322f830,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "address": "fa:16:3e:6e:7d:58", "network": {"id": "af5d1879-5cbd-45d2-97c0-e6cc4ac39d01", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-49924591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72016ef51af8410c88eb0deb826ae3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645c2ddb-c3", "ovs_interfaceid": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Converting VIF {"id": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "address": "fa:16:3e:6e:7d:58", "network": {"id": "af5d1879-5cbd-45d2-97c0-e6cc4ac39d01", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-49924591-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "72016ef51af8410c88eb0deb826ae3ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap645c2ddb-c3", "ovs_interfaceid": "645c2ddb-c31c-454f-8f2f-615bec1fef32", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:7d:58,bridge_name='br-int',has_traffic_filtering=True,id=645c2ddb-c31c-454f-8f2f-615bec1fef32,network=Network(af5d1879-5cbd-45d2-97c0-e6cc4ac39d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap645c2ddb-c3') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG os_vif [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:7d:58,bridge_name='br-int',has_traffic_filtering=True,id=645c2ddb-c31c-454f-8f2f-615bec1fef32,network=Network(af5d1879-5cbd-45d2-97c0-e6cc4ac39d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap645c2ddb-c3') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap645c2ddb-c3, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5d35e1a-699a-49e7-88cf-1cad7210beef) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:04:30 user nova-compute[74646]: INFO os_vif [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:7d:58,bridge_name='br-int',has_traffic_filtering=True,id=645c2ddb-c31c-454f-8f2f-615bec1fef32,network=Network(af5d1879-5cbd-45d2-97c0-e6cc4ac39d01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap645c2ddb-c3')
Oct 26 16:04:30 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Deleting instance files /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830_del
Oct 26 16:04:30 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Deletion of /opt/stack/data/nova/instances/2bae2991-6c17-4d79-9dd8-1fc69322f830_del complete
Oct 26 16:04:30 user nova-compute[74646]: INFO nova.compute.manager [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Took 1.07 seconds to destroy the instance on the hypervisor.
Oct 26 16:04:30 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Refreshing inventories for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.304s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Updating ProviderTree inventory for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Updating inventory in ProviderTree for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Refreshing aggregate associations for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6, aggregates: None {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Refreshing trait associations for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd751613-c043-4903-b45c-1f19dccb0acb {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:31 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:04:31 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:04:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.021s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:31 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Deleted allocations for instance 4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f
Oct 26 16:04:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-95ff4b97-25fe-4da2-87c9-9add80ccc627 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "4f6e2359-e9ae-4bcb-a1d7-a3003e6bc05f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 14.123s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:31 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:04:31 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Took 1.14 seconds to deallocate network for instance.
Oct 26 16:04:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:32 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de is timed out.
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received event network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] No waiting events found dispatching network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:32 user nova-compute[74646]: WARNING nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received unexpected event network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 for instance with vm_state deleted and task_state None.
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received event network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] No waiting events found dispatching network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:32 user nova-compute[74646]: WARNING nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received unexpected event network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 for instance with vm_state deleted and task_state None.
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received event network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] No waiting events found dispatching network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:32 user nova-compute[74646]: WARNING nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received unexpected event network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 for instance with vm_state deleted and task_state None.
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received event network-vif-unplugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] No waiting events found dispatching network-vif-unplugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:32 user nova-compute[74646]: WARNING nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received unexpected event network-vif-unplugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 for instance with vm_state deleted and task_state None.
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received event network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Acquiring lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] No waiting events found dispatching network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:32 user nova-compute[74646]: WARNING nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received unexpected event network-vif-plugged-645c2ddb-c31c-454f-8f2f-615bec1fef32 for instance with vm_state deleted and task_state None.
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.manager [req-da216d38-56f1-4386-be90-59f3d50f0968 req-83c03b81-129c-4742-85de-d25969064c82 service nova] [instance: 2bae2991-6c17-4d79-9dd8-1fc69322f830] Received event network-vif-deleted-645c2ddb-c31c-454f-8f2f-615bec1fef32 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:32 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Successfully detached device vdb from instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de from the live domain config.
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lTufjnmw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:04:32 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:04:32 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:04:32 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7426MB free_disk=25.189434051513672GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a718a0-0269-4406-98f0-8d3bea2cc335]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:04:32 user nova-compute[74646]: No targets found.
Oct 26 16:04:32 user nova-compute[74646]: iSNS:
Oct 26 16:04:32 user nova-compute[74646]: No targets found.
Oct 26 16:04:32 user nova-compute[74646]: STATIC:
Oct 26 16:04:32 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a
Oct 26 16:04:32 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:32 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:32 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:04:32 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:32 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:32 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c
Oct 26 16:04:32 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:32 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:32 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335
Oct 26 16:04:32 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:32 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:32 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509
Oct 26 16:04:32 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:32 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:32 user nova-compute[74646]: FIRMWARE:
Oct 26 16:04:32 user nova-compute[74646]: No targets found.
Oct 26 16:04:32 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:04:32 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:04:32 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d23bdf-ac4c-4a23-b90c-241bb8ffccc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7924b04-44a3-428b-b756-e70df98e43da]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:04:32 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:04:32 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:32 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:04:32 user nova-compute[74646]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c (non-flash)
Oct 26 16:04:32 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a (non-flash)
Oct 26 16:04:32 user nova-compute[74646]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:04:32 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:32 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:04:32 user nova-compute[74646]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c (non-flash)
Oct 26 16:04:32 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e03b83a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a'): ({'sdb'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Removing single pathed devices sdb {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[497740c1-2d46-4a2b-8827-23a8745b4cbc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[372eac79-eac9-4a95-8735-50e67daa95f7]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Flushing IO for device /dev/sdb {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9ee2b6-7a66-490e-9fce-85fbb5d9b6dc]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdd0c9a3-9403-4971-a3e6-e8c4f7e50b1a]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edc721a-7ddc-4a1b-9d57-3fc6ad2f0ac2]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[55481db1-fbdc-4a11-a324-fefa79486cc7]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260]
Oct 26 16:04:32 user nova-compute[74646]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a, portal: 172.16.0.220,3260] successful.
Oct 26 16:04:32 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f5b9e4e1-2e04-4264-9c5d-7e6a5a6b824a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b739135-c24b-4838-8048-ac805cb4e7a1]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] <== disconnect_volume: return (373ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.949s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.382s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:32 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Deleted allocations for instance 2bae2991-6c17-4d79-9dd8-1fc69322f830
Oct 26 16:04:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb3fcb1d-8431-46ae-9e66-2cafea586af4 tempest-TestServerVolumeAttachmentScenario-352649452 tempest-TestServerVolumeAttachmentScenario-352649452-project-member] Lock "2bae2991-6c17-4d79-9dd8-1fc69322f830" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.359s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 96a71d00-27f0-4dbe-88cb-e6f296178e90 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 696aeb6d-33b0-4fd5-9b03-91375b0c30dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance cd751613-c043-4903-b45c-1f19dccb0acb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9afc1e60-016b-4505-a123-8ec2f4311d84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 670508e6-ee5a-4aa9-bb9a-a696205174b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:04:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Cleaning up deleted instances with incomplete migration  {{(pid=74646) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:04:33 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 is timed out.
Oct 26 16:04:33 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Successfully detached device vdb from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the live domain config.
Oct 26 16:04:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HMFmZjwo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:04:33 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0491fe7d-9be0-4583-a827-18ca2bda0ce5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:04:33 user nova-compute[74646]: No targets found.
Oct 26 16:04:33 user nova-compute[74646]: iSNS:
Oct 26 16:04:33 user nova-compute[74646]: No targets found.
Oct 26 16:04:33 user nova-compute[74646]: STATIC:
Oct 26 16:04:33 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:04:33 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:33 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:33 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c
Oct 26 16:04:33 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:33 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:33 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335
Oct 26 16:04:33 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:33 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:33 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509
Oct 26 16:04:33 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:33 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:33 user nova-compute[74646]: FIRMWARE:
Oct 26 16:04:33 user nova-compute[74646]: No targets found.
Oct 26 16:04:33 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:04:33 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:04:33 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[867f08f1-0c7c-42b0-8362-345ceccd10fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36ec38d-5688-4a0c-ba09-4b959053bd60]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:04:33 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:33 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:04:33 user nova-compute[74646]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c (non-flash)
Oct 26 16:04:33 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:04:33 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:33 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:04:33 user nova-compute[74646]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c (non-flash)
Oct 26 16:04:33 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d05eb0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c'): ({'sdd'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Removing single pathed devices sdd {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dd0ccb-7a1f-4e7c-b506-4c0160a85cbd]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e14ab6b-c1e1-4624-95b3-63bb7e5a76e7]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Flushing IO for device /dev/sdd {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b3867e-297e-41d6-83b8-302d350c0d34]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[028e8b15-8eff-4ddf-99d7-b4d35d46c42c]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e860714-7d80-4431-8d67-341d95c6c078]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23a0d30-67e6-43fd-a86b-91afa0888239]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c, portal: 172.16.0.220,3260]
Oct 26 16:04:33 user nova-compute[74646]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c, portal: 172.16.0.220,3260] successful.
Oct 26 16:04:33 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:998293e6-dd21-44fb-ac03-31edff3e383c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a586bdf-aab8-45f9-9483-642ea527a2b9]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.329s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] <== disconnect_volume: return (331ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:04:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:04:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:04:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:04:34 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:04:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:04:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:04:34 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:04:34 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Updating instance_info_cache with network_info: [{"id": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "address": "fa:16:3e:cc:b0:d3", "network": {"id": "d4f65670-c099-417c-97c5-e3233f89a476", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1710572970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fd26edea684a8d997c1b577ff8d859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a819f-2d", "ovs_interfaceid": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:04:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:04:34 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:04:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:04:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:04:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:04:34 user nova-compute[74646]: DEBUG nova.objects.instance [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lazy-loading 'flavor' on Instance uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:04:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6880a5ab-af9d-460b-8cd8-18b411beb6d6 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.879s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-ac263c64-0b4e-4884-9daa-2a5c26ee1515 req-c670aa25-6662-4729-b372-310270400560 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-changed-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-ac263c64-0b4e-4884-9daa-2a5c26ee1515 req-c670aa25-6662-4729-b372-310270400560 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Refreshing instance network info cache due to event network-changed-6ac5e586-1f3c-4057-8e24-73a8d6de614a. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:04:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ac263c64-0b4e-4884-9daa-2a5c26ee1515 req-c670aa25-6662-4729-b372-310270400560 service nova] Acquiring lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:04:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ac263c64-0b4e-4884-9daa-2a5c26ee1515 req-c670aa25-6662-4729-b372-310270400560 service nova] Acquired lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:04:37 user nova-compute[74646]: DEBUG nova.network.neutron [req-ac263c64-0b4e-4884-9daa-2a5c26ee1515 req-c670aa25-6662-4729-b372-310270400560 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Refreshing network info cache for port 6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:04:37 user nova-compute[74646]: DEBUG nova.network.neutron [req-ac263c64-0b4e-4884-9daa-2a5c26ee1515 req-c670aa25-6662-4729-b372-310270400560 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Updated VIF entry in instance network info cache for port 6ac5e586-1f3c-4057-8e24-73a8d6de614a. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:04:37 user nova-compute[74646]: DEBUG nova.network.neutron [req-ac263c64-0b4e-4884-9daa-2a5c26ee1515 req-c670aa25-6662-4729-b372-310270400560 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Updating instance_info_cache with network_info: [{"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:04:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ac263c64-0b4e-4884-9daa-2a5c26ee1515 req-c670aa25-6662-4729-b372-310270400560 service nova] Releasing lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:04:38 user nova-compute[74646]: DEBUG nova.compute.manager [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:04:38 user nova-compute[74646]: INFO nova.compute.manager [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] instance snapshotting
Oct 26 16:04:38 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Beginning live snapshot process
Oct 26 16:04:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json -f qcow2 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json -f qcow2 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.172s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxvglre1d/edb8832d052248a48606209572d8f5b5.delta 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpxvglre1d/edb8832d052248a48606209572d8f5b5.delta 1073741824" returned: 0 in 0.054s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:39 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 16:04:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:40 user nova-compute[74646]: INFO nova.compute.manager [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Terminating instance
Oct 26 16:04:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] COPY block job progress, current cursor: 23134208 final cursor: 75563008 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-7a831437-605c-478c-b826-e13e042f6978 req-a2f81ffd-c26b-47ec-a78a-a9281f9367cc service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-vif-unplugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7a831437-605c-478c-b826-e13e042f6978 req-a2f81ffd-c26b-47ec-a78a-a9281f9367cc service nova] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7a831437-605c-478c-b826-e13e042f6978 req-a2f81ffd-c26b-47ec-a78a-a9281f9367cc service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7a831437-605c-478c-b826-e13e042f6978 req-a2f81ffd-c26b-47ec-a78a-a9281f9367cc service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-7a831437-605c-478c-b826-e13e042f6978 req-a2f81ffd-c26b-47ec-a78a-a9281f9367cc service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] No waiting events found dispatching network-vif-unplugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-7a831437-605c-478c-b826-e13e042f6978 req-a2f81ffd-c26b-47ec-a78a-a9281f9367cc service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-vif-unplugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 16:04:41 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 16:04:41 user nova-compute[74646]: DEBUG nova.objects.instance [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lazy-loading 'flavor' on Instance uuid b79f5ea4-ea88-41b4-8ca2-116b5b6408de {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4b9ff617-20d9-4e7a-b29a-176a7f627746 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 29.822s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG nova.privsep.utils [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74646) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxvglre1d/edb8832d052248a48606209572d8f5b5.delta /opt/stack/data/nova/instances/snapshots/tmpxvglre1d/edb8832d052248a48606209572d8f5b5 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:41 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Instance destroyed successfully.
Oct 26 16:04:41 user nova-compute[74646]: DEBUG nova.objects.instance [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lazy-loading 'resources' on Instance uuid 96a71d00-27f0-4dbe-88cb-e6f296178e90 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:55:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-577894992',display_name='tempest-ServerActionsTestOtherB-server-577894992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-577894992',id=16,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN8WuJBWWQ3dPKpsfd3pTt9BdyjBEif+cyL8w8Tg3VzJlkHtDxzbffk6KqqzEPT5s/X3OVnkganTQcqlWVpiRN+miRvt4exLQM5oDzUYlmj5/y40opmavHEPxTdEvfSLNw==',key_name='tempest-keypair-721457332',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:02:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5c99559f6003420bb1014bdb0f0988ff',ramdisk_id='',reservation_id='r-4yydauu2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1825400277',owner_user_name='tempest-ServerActionsTestOtherB-1825400277-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:02:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86031b2e164644e0a59efcd110ddf497',uuid=96a71d00-27f0-4dbe-88cb-e6f296178e90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converting VIF {"id": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "address": "fa:16:3e:7e:a4:63", "network": {"id": "2801c575-c308-4c94-a5ca-edbfa94f8116", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1494730225-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5c99559f6003420bb1014bdb0f0988ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e16bb7b-c1", "ovs_interfaceid": "3e16bb7b-c1c2-4a11-aad9-2da2fbae632b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_vif [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e16bb7b-c1, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d8cbd1e-419f-4c48-acc6-d420944bef09) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:41 user nova-compute[74646]: INFO os_vif [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:a4:63,bridge_name='br-int',has_traffic_filtering=True,id=3e16bb7b-c1c2-4a11-aad9-2da2fbae632b,network=Network(2801c575-c308-4c94-a5ca-edbfa94f8116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e16bb7b-c1')
Oct 26 16:04:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zIAGxZjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:04:41 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6305a76d-564e-463e-9a20-b57ad1df6978]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:04:41 user nova-compute[74646]: No targets found.
Oct 26 16:04:41 user nova-compute[74646]: iSNS:
Oct 26 16:04:41 user nova-compute[74646]: No targets found.
Oct 26 16:04:41 user nova-compute[74646]: STATIC:
Oct 26 16:04:41 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:04:41 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:41 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:41 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335
Oct 26 16:04:41 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:41 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:41 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509
Oct 26 16:04:41 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:41 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:41 user nova-compute[74646]: FIRMWARE:
Oct 26 16:04:41 user nova-compute[74646]: No targets found.
Oct 26 16:04:41 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:04:41 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:04:41 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[871d3b42-7bcb-4717-a78e-d3ba68d71c04]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b547b898-edc4-44ca-8bbd-8e3366e502ad]: (4, ('tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:04:41 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:41 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:04:41 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsi session list stdout=tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 (non-flash)
Oct 26 16:04:41 user nova-compute[74646]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:41 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:04:41 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e8397c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509'): ({'sdc'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Removing single pathed devices sdc {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9441c8ee-aa41-47cc-b85b-71182382c768]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b14632-bf6e-4733-963d-6ae404a5fc83]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Flushing IO for device /dev/sdc {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.032s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[115c4e48-7ffb-46ec-bc38-020df12b2e92]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c0ef24-63a2-4d6f-bf8c-2cdfc2aba1d2]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e787f30-5b95-41a5-986e-0e7f71e1e837]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d5c3013-3894-4542-bf77-6dd8274d1bf1]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260]
Oct 26 16:04:42 user nova-compute[74646]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509, portal: 172.16.0.220,3260] successful.
Oct 26 16:04:42 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f149e265-10cd-4341-9baf-859d99ae7509 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0508ba0d-002c-454b-a074-e32fd0f97faa]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] <== disconnect_volume: return (410ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:04:42 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Deleting instance files /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90_del
Oct 26 16:04:42 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Deletion of /opt/stack/data/nova/instances/96a71d00-27f0-4dbe-88cb-e6f296178e90_del complete
Oct 26 16:04:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpxvglre1d/edb8832d052248a48606209572d8f5b5.delta /opt/stack/data/nova/instances/snapshots/tmpxvglre1d/edb8832d052248a48606209572d8f5b5" returned: 0 in 0.748s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:42 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Snapshot extracted, beginning image upload
Oct 26 16:04:42 user nova-compute[74646]: INFO nova.compute.manager [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Took 1.58 seconds to destroy the instance on the hypervisor.
Oct 26 16:04:42 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-62a1ecfe-353d-4c5c-a105-c17f5c3be427 req-0013594c-4529-4d9b-884c-54cd625f1ed0 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-62a1ecfe-353d-4c5c-a105-c17f5c3be427 req-0013594c-4529-4d9b-884c-54cd625f1ed0 service nova] Acquiring lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-62a1ecfe-353d-4c5c-a105-c17f5c3be427 req-0013594c-4529-4d9b-884c-54cd625f1ed0 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-62a1ecfe-353d-4c5c-a105-c17f5c3be427 req-0013594c-4529-4d9b-884c-54cd625f1ed0 service nova] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-62a1ecfe-353d-4c5c-a105-c17f5c3be427 req-0013594c-4529-4d9b-884c-54cd625f1ed0 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] No waiting events found dispatching network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:42 user nova-compute[74646]: WARNING nova.compute.manager [req-62a1ecfe-353d-4c5c-a105-c17f5c3be427 req-0013594c-4529-4d9b-884c-54cd625f1ed0 service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received unexpected event network-vif-plugged-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b for instance with vm_state active and task_state deleting.
Oct 26 16:04:42 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:04:42 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Took 0.85 seconds to deallocate network for instance.
Oct 26 16:04:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-be44c26b-1fda-47b6-b5d6-2dd76c4e3d51 req-067afa88-1edd-4b58-8f49-1655de2eac0f service nova] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Received event network-vif-deleted-3e16bb7b-c1c2-4a11-aad9-2da2fbae632b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:43 user nova-compute[74646]: INFO nova.compute.manager [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] [instance: 96a71d00-27f0-4dbe-88cb-e6f296178e90] Took 0.93 seconds to detach 1 volumes for instance.
Oct 26 16:04:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:44 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:04:44 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:04:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.341s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:44 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Deleted allocations for instance 96a71d00-27f0-4dbe-88cb-e6f296178e90
Oct 26 16:04:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-71af9a9a-72bb-4d06-af3e-51a1029d2f03 tempest-ServerActionsTestOtherB-1825400277 tempest-ServerActionsTestOtherB-1825400277-project-member] Lock "96a71d00-27f0-4dbe-88cb-e6f296178e90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.940s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:44 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Snapshot image upload complete
Oct 26 16:04:44 user nova-compute[74646]: INFO nova.compute.manager [None req-d5a30708-fc6a-486b-99b8-bdcfcac30d6b tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Took 6.32 seconds to snapshot the instance on the hypervisor.
Oct 26 16:04:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:50 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd751613-c043-4903-b45c-1f19dccb0acb is timed out.
Oct 26 16:04:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Successfully detached device vdb from instance cd751613-c043-4903-b45c-1f19dccb0acb from the live domain config.
Oct 26 16:04:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnPIspuY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:04:50 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a52e14-ec44-4b2b-b94b-c26bcd866568]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:04:50 user nova-compute[74646]: No targets found.
Oct 26 16:04:50 user nova-compute[74646]: iSNS:
Oct 26 16:04:50 user nova-compute[74646]: No targets found.
Oct 26 16:04:50 user nova-compute[74646]: STATIC:
Oct 26 16:04:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:04:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335
Oct 26 16:04:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:50 user nova-compute[74646]: FIRMWARE:
Oct 26 16:04:50 user nova-compute[74646]: No targets found.
Oct 26 16:04:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:04:50 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:04:50 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9762f6-ff5e-4d4d-ab91-74453535996f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[da86470c-5508-4cb6-bc33-ee43ee5283af]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:50 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:04:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:50 user nova-compute[74646]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 (non-flash)
Oct 26 16:04:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e03b8ca0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335'): ({'sdf'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Removing single pathed devices sdf {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9220122-34a0-4c96-82ed-fbcb1deaa990]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f335caf-2039-4fed-88d4-cee212aff69f]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Flushing IO for device /dev/sdf {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c4a7b8-e6d8-4090-84ec-672248b60918]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.041s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9e61a7-8e00-4389-86cb-7a1410d25749]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] SCSI volumes sdf have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[460242c8-e865-437c-84c2-15002981edaf]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[604bd0a1-c5c3-4d2a-b681-7233039f661b]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335, portal: 172.16.0.220,3260]
Oct 26 16:04:51 user nova-compute[74646]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335, portal: 172.16.0.220,3260] successful.
Oct 26 16:04:51 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e642fb68-fb6d-43b6-9537-e917ced24991]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:04:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:04:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] <== disconnect_volume: return (308ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:04:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:04:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG nova.objects.instance [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lazy-loading 'flavor' on Instance uuid cd751613-c043-4903-b45c-1f19dccb0acb {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-be21d667-ae26-4b8b-b509-fd3a327c98f4 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "cd751613-c043-4903-b45c-1f19dccb0acb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.332s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "cd751613-c043-4903-b45c-1f19dccb0acb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 25.126s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:55 user nova-compute[74646]: INFO nova.compute.manager [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Terminating instance
Oct 26 16:04:55 user nova-compute[74646]: DEBUG nova.compute.manager [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-2317a912-1293-471d-a849-5bdd79c938ab req-6e81b6a1-2246-4c1a-99fd-ddd68d8fa33d service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Received event network-vif-unplugged-19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2317a912-1293-471d-a849-5bdd79c938ab req-6e81b6a1-2246-4c1a-99fd-ddd68d8fa33d service nova] Acquiring lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2317a912-1293-471d-a849-5bdd79c938ab req-6e81b6a1-2246-4c1a-99fd-ddd68d8fa33d service nova] Lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2317a912-1293-471d-a849-5bdd79c938ab req-6e81b6a1-2246-4c1a-99fd-ddd68d8fa33d service nova] Lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-2317a912-1293-471d-a849-5bdd79c938ab req-6e81b6a1-2246-4c1a-99fd-ddd68d8fa33d service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] No waiting events found dispatching network-vif-unplugged-19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-2317a912-1293-471d-a849-5bdd79c938ab req-6e81b6a1-2246-4c1a-99fd-ddd68d8fa33d service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Received event network-vif-unplugged-19fab0cc-b1c5-471b-8fae-30eec3d6659c for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:04:55 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Instance destroyed successfully.
Oct 26 16:04:55 user nova-compute[74646]: DEBUG nova.objects.instance [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lazy-loading 'resources' on Instance uuid cd751613-c043-4903-b45c-1f19dccb0acb {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:01:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-961067970',display_name='tempest-VolumesSnapshotTestJSON-instance-961067970',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-961067970',id=26,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQX2EOflT3LIH0+4IqtbGMfMknrvrujSBmqe3/EFvvUBhyvMkdPmcNQzcLIKjdnAAYNgcKX5T+MLJ0BofI3T2uBI8uDMjnY8HZDayyhQEx13a7AvaXRmgSuqSh0C7I8Bg==',key_name='tempest-keypair-976819839',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:01:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='94630fc764f54e5782d3551bfe65e882',ramdisk_id='',reservation_id='r-9orvcfkn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1332594439',owner_user_name='tempest-VolumesSnapshotTestJSON-1332594439-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:01:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b57a8707539042deafe65215e10974eb',uuid=cd751613-c043-4903-b45c-1f19dccb0acb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "address": "fa:16:3e:07:b0:59", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19fab0cc-b1", "ovs_interfaceid": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Converting VIF {"id": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "address": "fa:16:3e:07:b0:59", "network": {"id": "a8f622c2-5f60-4987-ad67-fe6d77ba5a9f", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1161856263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "94630fc764f54e5782d3551bfe65e882", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap19fab0cc-b1", "ovs_interfaceid": "19fab0cc-b1c5-471b-8fae-30eec3d6659c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:07:b0:59,bridge_name='br-int',has_traffic_filtering=True,id=19fab0cc-b1c5-471b-8fae-30eec3d6659c,network=Network(a8f622c2-5f60-4987-ad67-fe6d77ba5a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19fab0cc-b1') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG os_vif [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:b0:59,bridge_name='br-int',has_traffic_filtering=True,id=19fab0cc-b1c5-471b-8fae-30eec3d6659c,network=Network(a8f622c2-5f60-4987-ad67-fe6d77ba5a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19fab0cc-b1') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap19fab0cc-b1, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0423cbf2-329e-40fc-b460-e68fe84dceb0) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:04:56 user nova-compute[74646]: INFO os_vif [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:07:b0:59,bridge_name='br-int',has_traffic_filtering=True,id=19fab0cc-b1c5-471b-8fae-30eec3d6659c,network=Network(a8f622c2-5f60-4987-ad67-fe6d77ba5a9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap19fab0cc-b1')
Oct 26 16:04:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QnPIspuY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:04:56 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:04:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5118cdfd-3b2e-48ae-96bd-93a2a4e916fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:04:56 user nova-compute[74646]: No targets found.
Oct 26 16:04:56 user nova-compute[74646]: iSNS:
Oct 26 16:04:56 user nova-compute[74646]: No targets found.
Oct 26 16:04:56 user nova-compute[74646]: STATIC:
Oct 26 16:04:56 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:04:56 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:04:56 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:04:56 user nova-compute[74646]: FIRMWARE:
Oct 26 16:04:56 user nova-compute[74646]: No targets found.
Oct 26 16:04:56 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:04:56 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:04:56 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8f898821-3888-4bc8-9957-783fc1f36335', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1a9c8b-3ca1-4893-b724-4560d7367ac7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bd99b4-cfc6-4814-b6eb-8ba5ae2009a9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:56 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:04:56 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e8255f30>, {}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Disconnecting from: [] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.066s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] <== disconnect_volume: return (68ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:04:56 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Deleting instance files /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb_del
Oct 26 16:04:56 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Deletion of /opt/stack/data/nova/instances/cd751613-c043-4903-b45c-1f19dccb0acb_del complete
Oct 26 16:04:56 user nova-compute[74646]: INFO nova.compute.manager [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 26 16:04:56 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:04:56 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Took 0.72 seconds to deallocate network for instance.
Oct 26 16:04:56 user nova-compute[74646]: WARNING nova.volume.cinder [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Attachment 631f2c47-1896-4a5c-8480-31ae821e710d does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 631f2c47-1896-4a5c-8480-31ae821e710d. (HTTP 404) (Request-ID: req-47615b8a-389f-4462-808b-a1a945f5010d)
Oct 26 16:04:56 user nova-compute[74646]: INFO nova.compute.manager [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Took 0.03 seconds to detach 1 volumes for instance.
Oct 26 16:04:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-06c50217-a24e-4d27-9b60-e647d24511b4 req-e4d8bab8-5d88-417c-84bb-e8ae5748f41a service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Received event network-vif-deleted-19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:57 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:04:57 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:04:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.302s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:57 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Deleted allocations for instance cd751613-c043-4903-b45c-1f19dccb0acb
Oct 26 16:04:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-4be70f7c-5046-4f83-aa25-593540ea64f3 tempest-VolumesSnapshotTestJSON-1332594439 tempest-VolumesSnapshotTestJSON-1332594439-project-member] Lock "cd751613-c043-4903-b45c-1f19dccb0acb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.219s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-290c5b27-beb7-4c14-96d3-e30770ead9cc req-2cf4b2a1-d517-4771-9a7c-2bae28b3cfd2 service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Received event network-vif-plugged-19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:04:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-290c5b27-beb7-4c14-96d3-e30770ead9cc req-2cf4b2a1-d517-4771-9a7c-2bae28b3cfd2 service nova] Acquiring lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:04:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-290c5b27-beb7-4c14-96d3-e30770ead9cc req-2cf4b2a1-d517-4771-9a7c-2bae28b3cfd2 service nova] Lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:04:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-290c5b27-beb7-4c14-96d3-e30770ead9cc req-2cf4b2a1-d517-4771-9a7c-2bae28b3cfd2 service nova] Lock "cd751613-c043-4903-b45c-1f19dccb0acb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:04:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-290c5b27-beb7-4c14-96d3-e30770ead9cc req-2cf4b2a1-d517-4771-9a7c-2bae28b3cfd2 service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] No waiting events found dispatching network-vif-plugged-19fab0cc-b1c5-471b-8fae-30eec3d6659c {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:04:57 user nova-compute[74646]: WARNING nova.compute.manager [req-290c5b27-beb7-4c14-96d3-e30770ead9cc req-2cf4b2a1-d517-4771-9a7c-2bae28b3cfd2 service nova] [instance: cd751613-c043-4903-b45c-1f19dccb0acb] Received unexpected event network-vif-plugged-19fab0cc-b1c5-471b-8fae-30eec3d6659c for instance with vm_state deleted and task_state None.
Oct 26 16:05:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:02 user nova-compute[74646]: INFO nova.compute.manager [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Terminating instance
Oct 26 16:05:02 user nova-compute[74646]: DEBUG nova.compute.manager [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-a2821f75-8bdf-4825-af1c-dba15c4f1d42 req-4fbed1ab-9183-4e60-b0fb-ff61d523322e service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received event network-vif-unplugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a2821f75-8bdf-4825-af1c-dba15c4f1d42 req-4fbed1ab-9183-4e60-b0fb-ff61d523322e service nova] Acquiring lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a2821f75-8bdf-4825-af1c-dba15c4f1d42 req-4fbed1ab-9183-4e60-b0fb-ff61d523322e service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a2821f75-8bdf-4825-af1c-dba15c4f1d42 req-4fbed1ab-9183-4e60-b0fb-ff61d523322e service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-a2821f75-8bdf-4825-af1c-dba15c4f1d42 req-4fbed1ab-9183-4e60-b0fb-ff61d523322e service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] No waiting events found dispatching network-vif-unplugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-a2821f75-8bdf-4825-af1c-dba15c4f1d42 req-4fbed1ab-9183-4e60-b0fb-ff61d523322e service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received event network-vif-unplugged-c3fa2d89-235f-4939-8eff-e59c02c578fe for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:03 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Instance destroyed successfully.
Oct 26 16:05:03 user nova-compute[74646]: DEBUG nova.objects.instance [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lazy-loading 'resources' on Instance uuid b79f5ea4-ea88-41b4-8ca2-116b5b6408de {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:05:03 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-587138455',display_name='tempest-ServerActionsTestOtherA-server-1879145648',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-587138455',id=20,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbmmCHSiAv6wnl4y6udIFIXZEW/bOp74proj1U5AEM0+QPtfownIPyTApMq9brABhT3IwnIfBs9QKjt04IQsymoSPOFRANJzeHzmMShY1+CCmigklKl+J5T9ZIigvKl+w==',key_name='tempest-keypair-1281352566',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:01:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-y115hib0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:01:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=b79f5ea4-ea88-41b4-8ca2-116b5b6408de,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:05:03 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "address": "fa:16:3e:60:7f:15", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc3fa2d89-23", "ovs_interfaceid": "c3fa2d89-235f-4939-8eff-e59c02c578fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:05:03 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:60:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=c3fa2d89-235f-4939-8eff-e59c02c578fe,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fa2d89-23') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:05:03 user nova-compute[74646]: DEBUG os_vif [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=c3fa2d89-235f-4939-8eff-e59c02c578fe,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fa2d89-23') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:05:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc3fa2d89-23, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:05:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d42c3a85-2fdc-46b0-9f4a-e251aa0535c1) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:05:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:03 user nova-compute[74646]: INFO os_vif [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:60:7f:15,bridge_name='br-int',has_traffic_filtering=True,id=c3fa2d89-235f-4939-8eff-e59c02c578fe,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc3fa2d89-23')
Oct 26 16:05:03 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Deleting instance files /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de_del
Oct 26 16:05:03 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Deletion of /opt/stack/data/nova/instances/b79f5ea4-ea88-41b4-8ca2-116b5b6408de_del complete
Oct 26 16:05:03 user nova-compute[74646]: INFO nova.compute.manager [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 26 16:05:03 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:05:03 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:05:03 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:05:04 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:05:04 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Took 1.20 seconds to deallocate network for instance.
Oct 26 16:05:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:04 user nova-compute[74646]: DEBUG nova.compute.manager [req-411ed789-8b21-4ea4-accb-d1c7f3d008cc req-3004d65c-763f-4b97-aed2-e173ad4e34c4 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received event network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:05:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-411ed789-8b21-4ea4-accb-d1c7f3d008cc req-3004d65c-763f-4b97-aed2-e173ad4e34c4 service nova] Acquiring lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-411ed789-8b21-4ea4-accb-d1c7f3d008cc req-3004d65c-763f-4b97-aed2-e173ad4e34c4 service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-411ed789-8b21-4ea4-accb-d1c7f3d008cc req-3004d65c-763f-4b97-aed2-e173ad4e34c4 service nova] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:04 user nova-compute[74646]: DEBUG nova.compute.manager [req-411ed789-8b21-4ea4-accb-d1c7f3d008cc req-3004d65c-763f-4b97-aed2-e173ad4e34c4 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] No waiting events found dispatching network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:05:04 user nova-compute[74646]: WARNING nova.compute.manager [req-411ed789-8b21-4ea4-accb-d1c7f3d008cc req-3004d65c-763f-4b97-aed2-e173ad4e34c4 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received unexpected event network-vif-plugged-c3fa2d89-235f-4939-8eff-e59c02c578fe for instance with vm_state deleted and task_state None.
Oct 26 16:05:04 user nova-compute[74646]: DEBUG nova.compute.manager [req-411ed789-8b21-4ea4-accb-d1c7f3d008cc req-3004d65c-763f-4b97-aed2-e173ad4e34c4 service nova] [instance: b79f5ea4-ea88-41b4-8ca2-116b5b6408de] Received event network-vif-deleted-c3fa2d89-235f-4939-8eff-e59c02c578fe {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:05:04 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:05:04 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:05:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:04 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Deleted allocations for instance b79f5ea4-ea88-41b4-8ca2-116b5b6408de
Oct 26 16:05:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32131461-8184-4661-b690-663c7f9f0a8d tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "b79f5ea4-ea88-41b4-8ca2-116b5b6408de" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.596s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG nova.objects.instance [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lazy-loading 'flavor' on Instance uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:09 user nova-compute[74646]: INFO nova.compute.manager [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Attaching volume 3a036017-b5df-4cac-98b5-379175052ffd to /dev/vdb
Oct 26 16:05:09 user nova-compute[74646]: DEBUG os_brick.utils [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03b1563-9dbe-4264-91c4-68102cda3344]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[23624309-2e6f-40f5-8d76-0d2caf018510]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ec9ed0-bf78-47ef-91a4-e37db2d1a676]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b427042c-df86-4b8c-ae3c-e55e86c7ea48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:05:09 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:05:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d4b53c-d293-4f46-8659-d2d158bcfbe6]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG os_brick.utils [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:05:09 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Updating existing volume attachment record: 97452c01-ea4f-45ff-8d21-2f33b2e5b18b {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:05:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_power_states {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 1283575f-b614-42d5-b632-c1409f295207 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 696aeb6d-33b0-4fd5-9b03-91375b0c30dc {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid fa8813a4-be8c-452a-8d2d-a5fd972c2498 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 9afc1e60-016b-4505-a123-8ec2f4311d84 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 670508e6-ee5a-4aa9-bb9a-a696205174b8 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "1283575f-b614-42d5-b632-c1409f295207" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "1283575f-b614-42d5-b632-c1409f295207" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "1283575f-b614-42d5-b632-c1409f295207" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:05:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:05:24 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:05:26 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:05:26 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:05:27 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:05:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:05:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:05:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:05:27 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1283575f-b614-42d5-b632-c1409f295207] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:05:27 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1283575f-b614-42d5-b632-c1409f295207] Updating instance_info_cache with network_info: [{"id": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "address": "fa:16:3e:1b:cc:e1", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap366498f3-12", "ovs_interfaceid": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:05:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:05:28 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1283575f-b614-42d5-b632-c1409f295207] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:05:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:05:28 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:05:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:28 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:05:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:05:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/disk.rescue --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/disk.rescue --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:31 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:05:31 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:05:31 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7781MB free_disk=25.204872131347656GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:05:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:05:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:05:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:05:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 696aeb6d-33b0-4fd5-9b03-91375b0c30dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:05:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:05:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9afc1e60-016b-4505-a123-8ec2f4311d84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:05:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 670508e6-ee5a-4aa9-bb9a-a696205174b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:05:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:05:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:05:32 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:05:32 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:05:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:05:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.385s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:05:33 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:05:33 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:05:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:05:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:05:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 16:05:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:05:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:05:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:43 user nova-compute[74646]: INFO nova.compute.manager [None req-0f496d45-05df-41a6-b3f5-fa6deb2926e0 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Unrescuing
Oct 26 16:05:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0f496d45-05df-41a6-b3f5-fa6deb2926e0 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:05:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0f496d45-05df-41a6-b3f5-fa6deb2926e0 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquired lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:05:43 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0f496d45-05df-41a6-b3f5-fa6deb2926e0 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:05:43 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0f496d45-05df-41a6-b3f5-fa6deb2926e0 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Updating instance_info_cache with network_info: [{"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:05:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0f496d45-05df-41a6-b3f5-fa6deb2926e0 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Releasing lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:05:43 user nova-compute[74646]: DEBUG nova.objects.instance [None req-0f496d45-05df-41a6-b3f5-fa6deb2926e0 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'flavor' on Instance uuid fa8813a4-be8c-452a-8d2d-a5fd972c2498 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:05:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:44 user nova-compute[74646]: DEBUG nova.compute.manager [req-fe991a3f-d862-451f-8402-dd1b628bddea req-fe42b1d7-3a68-4405-84f3-01da1c0b6b8b service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-vif-unplugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:05:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fe991a3f-d862-451f-8402-dd1b628bddea req-fe42b1d7-3a68-4405-84f3-01da1c0b6b8b service nova] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fe991a3f-d862-451f-8402-dd1b628bddea req-fe42b1d7-3a68-4405-84f3-01da1c0b6b8b service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fe991a3f-d862-451f-8402-dd1b628bddea req-fe42b1d7-3a68-4405-84f3-01da1c0b6b8b service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:44 user nova-compute[74646]: DEBUG nova.compute.manager [req-fe991a3f-d862-451f-8402-dd1b628bddea req-fe42b1d7-3a68-4405-84f3-01da1c0b6b8b service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] No waiting events found dispatching network-vif-unplugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:05:44 user nova-compute[74646]: WARNING nova.compute.manager [req-fe991a3f-d862-451f-8402-dd1b628bddea req-fe42b1d7-3a68-4405-84f3-01da1c0b6b8b service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received unexpected event network-vif-unplugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 for instance with vm_state rescued and task_state unrescuing.
Oct 26 16:05:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:44 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Instance destroyed successfully.
Oct 26 16:05:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:46 user nova-compute[74646]: DEBUG nova.compute.manager [req-553b9360-b5fe-464b-896a-af9013b352c5 req-362906c3-7f0d-4a5d-a621-e4975b9f84fd service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:05:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-553b9360-b5fe-464b-896a-af9013b352c5 req-362906c3-7f0d-4a5d-a621-e4975b9f84fd service nova] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-553b9360-b5fe-464b-896a-af9013b352c5 req-362906c3-7f0d-4a5d-a621-e4975b9f84fd service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-553b9360-b5fe-464b-896a-af9013b352c5 req-362906c3-7f0d-4a5d-a621-e4975b9f84fd service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:46 user nova-compute[74646]: DEBUG nova.compute.manager [req-553b9360-b5fe-464b-896a-af9013b352c5 req-362906c3-7f0d-4a5d-a621-e4975b9f84fd service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] No waiting events found dispatching network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:05:46 user nova-compute[74646]: WARNING nova.compute.manager [req-553b9360-b5fe-464b-896a-af9013b352c5 req-362906c3-7f0d-4a5d-a621-e4975b9f84fd service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received unexpected event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 for instance with vm_state rescued and task_state unrescuing.
Oct 26 16:05:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "b4286998-93f6-439c-9c4e-b710d121420b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "b4286998-93f6-439c-9c4e-b710d121420b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:47 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:05:48 user nova-compute[74646]: INFO nova.compute.claims [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Claim successful on node user
Oct 26 16:05:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-8659042c-3538-415c-99f8-8980e5827b24 req-f8d70b09-c5c5-43b7-8f8e-c759d4dd8bf4 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8659042c-3538-415c-99f8-8980e5827b24 req-f8d70b09-c5c5-43b7-8f8e-c759d4dd8bf4 service nova] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8659042c-3538-415c-99f8-8980e5827b24 req-f8d70b09-c5c5-43b7-8f8e-c759d4dd8bf4 service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8659042c-3538-415c-99f8-8980e5827b24 req-f8d70b09-c5c5-43b7-8f8e-c759d4dd8bf4 service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-8659042c-3538-415c-99f8-8980e5827b24 req-f8d70b09-c5c5-43b7-8f8e-c759d4dd8bf4 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] No waiting events found dispatching network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:05:48 user nova-compute[74646]: WARNING nova.compute.manager [req-8659042c-3538-415c-99f8-8980e5827b24 req-f8d70b09-c5c5-43b7-8f8e-c759d4dd8bf4 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received unexpected event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 for instance with vm_state rescued and task_state unrescuing.
Oct 26 16:05:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-8659042c-3538-415c-99f8-8980e5827b24 req-f8d70b09-c5c5-43b7-8f8e-c759d4dd8bf4 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8659042c-3538-415c-99f8-8980e5827b24 req-f8d70b09-c5c5-43b7-8f8e-c759d4dd8bf4 service nova] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8659042c-3538-415c-99f8-8980e5827b24 req-f8d70b09-c5c5-43b7-8f8e-c759d4dd8bf4 service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8659042c-3538-415c-99f8-8980e5827b24 req-f8d70b09-c5c5-43b7-8f8e-c759d4dd8bf4 service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-8659042c-3538-415c-99f8-8980e5827b24 req-f8d70b09-c5c5-43b7-8f8e-c759d4dd8bf4 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] No waiting events found dispatching network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:05:48 user nova-compute[74646]: WARNING nova.compute.manager [req-8659042c-3538-415c-99f8-8980e5827b24 req-f8d70b09-c5c5-43b7-8f8e-c759d4dd8bf4 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received unexpected event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 for instance with vm_state rescued and task_state unrescuing.
Oct 26 16:05:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0f496d45-05df-41a6-b3f5-fa6deb2926e0 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:05:48 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:05:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:05:48 user nova-compute[74646]: INFO nova.virt.block_device [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Booting with volume 9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b at /dev/vda
Oct 26 16:05:48 user nova-compute[74646]: DEBUG nova.policy [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9419f9603ca647269ed1cf42e233507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a984c8da90ff476191cd5aa5787032c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG os_brick.utils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f7934b-aa42-4d80-a65c-bb33e91aa92c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[831d2f5b-8ca8-4597-b7d0-e51faf1caced]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb88a18-4bad-4941-ae5c-efa3a8b48dca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee1c4d8-8ecf-4363-b373-f0a681bad910]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:05:48 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:05:48 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaefd2f7-5c09-4d68-bfd2-d5c4cb1b421b]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG os_brick.utils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== get_connector_properties: return (190ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:05:48 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Updating existing volume attachment record: 42d38511-a845-4282-a4f4-ac6cf0da921e {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Successfully created port: ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNeXqDMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:05:50 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:05:50 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:05:50 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc821c4-f1b9-4f29-b66b-602c31c2bcce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:05:50 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf12664-ad28-48d0-be09-4c932f175864]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd] added
Oct 26 16:05:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4c6c6e-e944-48f3-9c10-96a2549caef4]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a36ba9-eb20-4beb-9889-17d88d1eebf9]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNeXqDMi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mNeXqDMi" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d63abe-4689-4dc3-9d40-deb1ae6dab20]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mNeXqDMi'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a673acf2-def7-4c1f-adef-ee73c8de28a2]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ad3ea5-df2d-4ca2-af01-c7af9ddd76c0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:05:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:05:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d258dc-5df5-4bf6-b4cc-83848995cd7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd, portal: 172.16.0.220,3260]
Oct 26 16:05:50 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd, portal: 172.16.0.220,3260] successful.
Oct 26 16:05:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aca76cf-af83-4fd8-af3b-bb77b5614684]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dedd55d-aa1a-4456-a718-444c5e2c46e2]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:05:50 user nova-compute[74646]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd (non-flash)
Oct 26 16:05:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:05:50 user nova-compute[74646]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd (non-flash)
Oct 26 16:05:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e5b8a1-a818-45a8-bc2e-7f23e32392ed]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:05:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNeXqDMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Successfully updated port: ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "refresh_cache-b4286998-93f6-439c-9c4e-b710d121420b" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquired lock "refresh_cache-b4286998-93f6-439c-9c4e-b710d121420b" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG nova.compute.manager [req-f4481eac-210f-4849-b6cc-52f61360fc67 req-568c29c3-0e99-4b47-be08-4d6ed17b6747 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Received event network-changed-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG nova.compute.manager [req-f4481eac-210f-4849-b6cc-52f61360fc67 req-568c29c3-0e99-4b47-be08-4d6ed17b6747 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Refreshing instance network info cache due to event network-changed-ff5ab62a-73fd-4dcc-90dd-6e5923446b97. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f4481eac-210f-4849-b6cc-52f61360fc67 req-568c29c3-0e99-4b47-be08-4d6ed17b6747 service nova] Acquiring lock "refresh_cache-b4286998-93f6-439c-9c4e-b710d121420b" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Updating instance_info_cache with network_info: [{"id": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "address": "fa:16:3e:5c:cb:d8", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5ab62a-73", "ovs_interfaceid": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Releasing lock "refresh_cache-b4286998-93f6-439c-9c4e-b710d121420b" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Instance network_info: |[{"id": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "address": "fa:16:3e:5c:cb:d8", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5ab62a-73", "ovs_interfaceid": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f4481eac-210f-4849-b6cc-52f61360fc67 req-568c29c3-0e99-4b47-be08-4d6ed17b6747 service nova] Acquired lock "refresh_cache-b4286998-93f6-439c-9c4e-b710d121420b" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG nova.network.neutron [req-f4481eac-210f-4849-b6cc-52f61360fc67 req-568c29c3-0e99-4b47-be08-4d6ed17b6747 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Refreshing network info cache for port ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26561396461366239', 'path': '/dev/sdb'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561396461366239', 'path': '/dev/sdb'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG nova.objects.instance [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lazy-loading 'flavor' on Instance uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:05:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:05:51 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:05:51 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 16:05:51 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:05:51 user nova-compute[74646]:   <serial>3a036017-b5df-4cac-98b5-379175052ffd</serial>
Oct 26 16:05:51 user nova-compute[74646]: </disk>
Oct 26 16:05:51 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:05:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:05:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:05:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] No VIF found with MAC fa:16:3e:cc:b0:d3, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:05:52 user nova-compute[74646]: DEBUG nova.network.neutron [req-f4481eac-210f-4849-b6cc-52f61360fc67 req-568c29c3-0e99-4b47-be08-4d6ed17b6747 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Updated VIF entry in instance network info cache for port ff5ab62a-73fd-4dcc-90dd-6e5923446b97. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:05:52 user nova-compute[74646]: DEBUG nova.network.neutron [req-f4481eac-210f-4849-b6cc-52f61360fc67 req-568c29c3-0e99-4b47-be08-4d6ed17b6747 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Updating instance_info_cache with network_info: [{"id": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "address": "fa:16:3e:5c:cb:d8", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5ab62a-73", "ovs_interfaceid": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:05:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f4481eac-210f-4849-b6cc-52f61360fc67 req-568c29c3-0e99-4b47-be08-4d6ed17b6747 service nova] Releasing lock "refresh_cache-b4286998-93f6-439c-9c4e-b710d121420b" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:05:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-34ad7cf9-6147-4a60-9a97-7744a3f670b0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.808s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 37.015s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:05:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:05:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:05:54 user nova-compute[74646]: INFO nova.compute.manager [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Detaching volume 3a036017-b5df-4cac-98b5-379175052ffd
Oct 26 16:05:54 user nova-compute[74646]: INFO nova.virt.block_device [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Attempting to driver detach volume 3a036017-b5df-4cac-98b5-379175052ffd from mountpoint /dev/vdb
Oct 26 16:05:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Attempting to detach device vdb from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:05:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:05:54 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:05:54 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 16:05:54 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:05:54 user nova-compute[74646]:   <serial>3a036017-b5df-4cac-98b5-379175052ffd</serial>
Oct 26 16:05:54 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:05:54 user nova-compute[74646]: </disk>
Oct 26 16:05:54 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:05:54 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Successfully detached device vdb from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the persistent domain config.
Oct 26 16:05:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:05:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:05:54 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:05:54 user nova-compute[74646]:   <source dev="/dev/sdb"/>
Oct 26 16:05:54 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:05:54 user nova-compute[74646]:   <serial>3a036017-b5df-4cac-98b5-379175052ffd</serial>
Oct 26 16:05:54 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:05:54 user nova-compute[74646]: </disk>
Oct 26 16:05:54 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:05:54 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:05:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:05:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:06:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 16:06:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:06:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:06:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:06:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 16:06:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:06:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:06:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG nova.objects.instance [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lazy-loading 'flavor' on Instance uuid 670508e6-ee5a-4aa9-bb9a-a696205174b8 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:12 user nova-compute[74646]: INFO nova.compute.manager [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Attaching volume 00d0f839-ae84-49dc-a16f-530f1e9ee481 to /dev/vdb
Oct 26 16:06:12 user nova-compute[74646]: DEBUG os_brick.utils [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c057eed3-4c46-49b3-bc1c-49caea2d0753]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5878fd92-6910-4086-86a4-5010d1e9bfb8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[314c6b8d-84d5-4345-b28a-6c939ad29704]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80c81a7-cd61-48e1-83fc-954cb1211fbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:06:12 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:06:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1323b32f-6ef8-418e-af11-6d0a1b084d33]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG os_brick.utils [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:06:12 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Updating existing volume attachment record: 2854a332-4f67-47fc-a9c9-c99a57ecab72 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG nova.compute.manager [req-31d8096a-d82c-4999-a27d-2fc82078933f req-d79494a6-19d1-4725-8abd-c0fd38ac1187 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Received event network-changed-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG nova.compute.manager [req-31d8096a-d82c-4999-a27d-2fc82078933f req-d79494a6-19d1-4725-8abd-c0fd38ac1187 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Refreshing instance network info cache due to event network-changed-e76cc0df-d5d8-4cd5-abf4-cec6e536db86. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-31d8096a-d82c-4999-a27d-2fc82078933f req-d79494a6-19d1-4725-8abd-c0fd38ac1187 service nova] Acquiring lock "refresh_cache-696aeb6d-33b0-4fd5-9b03-91375b0c30dc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-31d8096a-d82c-4999-a27d-2fc82078933f req-d79494a6-19d1-4725-8abd-c0fd38ac1187 service nova] Acquired lock "refresh_cache-696aeb6d-33b0-4fd5-9b03-91375b0c30dc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG nova.network.neutron [req-31d8096a-d82c-4999-a27d-2fc82078933f req-d79494a6-19d1-4725-8abd-c0fd38ac1187 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Refreshing network info cache for port e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Acquiring lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Acquiring lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:13 user nova-compute[74646]: INFO nova.compute.manager [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Terminating instance
Oct 26 16:06:13 user nova-compute[74646]: DEBUG nova.compute.manager [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG nova.network.neutron [req-31d8096a-d82c-4999-a27d-2fc82078933f req-d79494a6-19d1-4725-8abd-c0fd38ac1187 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Updated VIF entry in instance network info cache for port e76cc0df-d5d8-4cd5-abf4-cec6e536db86. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG nova.network.neutron [req-31d8096a-d82c-4999-a27d-2fc82078933f req-d79494a6-19d1-4725-8abd-c0fd38ac1187 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Updating instance_info_cache with network_info: [{"id": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "address": "fa:16:3e:fd:e3:3f", "network": {"id": "0c31a8ed-93d5-4264-a423-1be36f607e77", "bridge": "br-int", "label": "tempest-TestStampPattern-1455596049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1aa9710cad4f8493c3ed49167ff876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76cc0df-d5", "ovs_interfaceid": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-31d8096a-d82c-4999-a27d-2fc82078933f req-d79494a6-19d1-4725-8abd-c0fd38ac1187 service nova] Releasing lock "refresh_cache-696aeb6d-33b0-4fd5-9b03-91375b0c30dc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:06:14 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Instance destroyed successfully.
Oct 26 16:06:14 user nova-compute[74646]: DEBUG nova.objects.instance [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lazy-loading 'resources' on Instance uuid 696aeb6d-33b0-4fd5-9b03-91375b0c30dc {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:01:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-495263237',display_name='tempest-TestStampPattern-server-495263237',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-495263237',id=24,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFwCHo1J75VKv6tOxJOFueps6MpuV3GNceWf93f7UVDDO8T2GQYqajdkvEwTTWSfQ1S7ZSR5+y4w9wZ0WrpSIx82lz1s6T8QHdhxm4ba049afyzdgsTZ79LJIlj3whnfOQ==',key_name='tempest-TestStampPattern-2091035763',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:01:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8f1aa9710cad4f8493c3ed49167ff876',ramdisk_id='',reservation_id='r-fs733gyf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-12700612',owner_user_name='tempest-TestStampPattern-12700612-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:01:11Z,user_data=None,user_id='fca6889c7d7c479fae967215bbb5ca12',uuid=696aeb6d-33b0-4fd5-9b03-91375b0c30dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "address": "fa:16:3e:fd:e3:3f", "network": {"id": "0c31a8ed-93d5-4264-a423-1be36f607e77", "bridge": "br-int", "label": "tempest-TestStampPattern-1455596049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1aa9710cad4f8493c3ed49167ff876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76cc0df-d5", "ovs_interfaceid": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Converting VIF {"id": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "address": "fa:16:3e:fd:e3:3f", "network": {"id": "0c31a8ed-93d5-4264-a423-1be36f607e77", "bridge": "br-int", "label": "tempest-TestStampPattern-1455596049-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8f1aa9710cad4f8493c3ed49167ff876", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape76cc0df-d5", "ovs_interfaceid": "e76cc0df-d5d8-4cd5-abf4-cec6e536db86", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:3f,bridge_name='br-int',has_traffic_filtering=True,id=e76cc0df-d5d8-4cd5-abf4-cec6e536db86,network=Network(0c31a8ed-93d5-4264-a423-1be36f607e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76cc0df-d5') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG os_vif [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:3f,bridge_name='br-int',has_traffic_filtering=True,id=e76cc0df-d5d8-4cd5-abf4-cec6e536db86,network=Network(0c31a8ed-93d5-4264-a423-1be36f607e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76cc0df-d5') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape76cc0df-d5, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0a77cc4-1af1-4ff6-adf8-f9a444bed03f) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:06:14 user nova-compute[74646]: INFO os_vif [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:e3:3f,bridge_name='br-int',has_traffic_filtering=True,id=e76cc0df-d5d8-4cd5-abf4-cec6e536db86,network=Network(0c31a8ed-93d5-4264-a423-1be36f607e77),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape76cc0df-d5')
Oct 26 16:06:14 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Deleting instance files /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc_del
Oct 26 16:06:14 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Deletion of /opt/stack/data/nova/instances/696aeb6d-33b0-4fd5-9b03-91375b0c30dc_del complete
Oct 26 16:06:14 user nova-compute[74646]: INFO nova.compute.manager [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Took 0.71 seconds to destroy the instance on the hypervisor.
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:06:14 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 is timed out.
Oct 26 16:06:14 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Successfully detached device vdb from instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 from the live domain config.
Oct 26 16:06:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mNeXqDMi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:06:14 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:06:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[632bdea6-f3eb-44be-9e0e-746a8bef3d8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:06:14 user nova-compute[74646]: No targets found.
Oct 26 16:06:14 user nova-compute[74646]: iSNS:
Oct 26 16:06:14 user nova-compute[74646]: No targets found.
Oct 26 16:06:14 user nova-compute[74646]: STATIC:
Oct 26 16:06:14 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd
Oct 26 16:06:14 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:06:14 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:06:14 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:06:14 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:06:14 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:06:14 user nova-compute[74646]: FIRMWARE:
Oct 26 16:06:14 user nova-compute[74646]: No targets found.
Oct 26 16:06:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:06:14 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:06:14 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:06:14 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Took 0.43 seconds to deallocate network for instance.
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[517beb30-bba7-4cec-94c6-e1f9a35e3df3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG nova.compute.manager [req-2056d46d-4e90-4c73-a474-e84f35fbdd4c req-9e31d480-7c18-461a-9c78-57e6effc6460 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Received event network-vif-deleted-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:06:14 user nova-compute[74646]: INFO nova.compute.manager [req-2056d46d-4e90-4c73-a474-e84f35fbdd4c req-9e31d480-7c18-461a-9c78-57e6effc6460 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Neutron deleted interface e76cc0df-d5d8-4cd5-abf4-cec6e536db86; detaching it from the instance and deleting it from the info cache
Oct 26 16:06:14 user nova-compute[74646]: DEBUG nova.network.neutron [req-2056d46d-4e90-4c73-a474-e84f35fbdd4c req-9e31d480-7c18-461a-9c78-57e6effc6460 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[28aef8e5-c190-4415-99c9-b405a483462d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:14 user nova-compute[74646]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd (non-flash)
Oct 26 16:06:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:14 user nova-compute[74646]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd (non-flash)
Oct 26 16:06:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e037add0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd'): ({'sdb'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Removing single pathed devices sdb {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG nova.compute.manager [req-2056d46d-4e90-4c73-a474-e84f35fbdd4c req-9e31d480-7c18-461a-9c78-57e6effc6460 service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Detach interface failed, port_id=e76cc0df-d5d8-4cd5-abf4-cec6e536db86, reason: Instance 696aeb6d-33b0-4fd5-9b03-91375b0c30dc could not be found. {{(pid=74646) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[75216993-8162-4d45-9144-2c73e4a6ecfa]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[462c28b4-b468-4236-8537-6519edd23eb1]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Flushing IO for device /dev/sdb {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f4ea7e-af4f-4c6b-92f2-d432d85e0d6b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7245c0b9-0ee5-4ea9-b854-f3d4c322eec0]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f4dcb0-950b-45c5-b721-82611af23641]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dddcec4-30fa-4420-9f08-c505c604aa33]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd, portal: 172.16.0.220,3260]
Oct 26 16:06:15 user nova-compute[74646]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd, portal: 172.16.0.220,3260] successful.
Oct 26 16:06:15 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a036017-b5df-4cac-98b5-379175052ffd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe3e4f2-7529-44de-aab8-18ac21ba9e2b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] <== disconnect_volume: return (341ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:15 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Deleted allocations for instance 696aeb6d-33b0-4fd5-9b03-91375b0c30dc
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-426a1d1a-aa8b-41c5-89ce-3b29498016e2 tempest-TestStampPattern-12700612 tempest-TestStampPattern-12700612-project-member] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.706s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-5546286c-cf56-4006-bd74-6072113cc1f3 req-37f46218-da62-41f2-8a31-d3234141284b service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Received event network-vif-unplugged-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5546286c-cf56-4006-bd74-6072113cc1f3 req-37f46218-da62-41f2-8a31-d3234141284b service nova] Acquiring lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5546286c-cf56-4006-bd74-6072113cc1f3 req-37f46218-da62-41f2-8a31-d3234141284b service nova] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5546286c-cf56-4006-bd74-6072113cc1f3 req-37f46218-da62-41f2-8a31-d3234141284b service nova] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-5546286c-cf56-4006-bd74-6072113cc1f3 req-37f46218-da62-41f2-8a31-d3234141284b service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] No waiting events found dispatching network-vif-unplugged-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:06:15 user nova-compute[74646]: WARNING nova.compute.manager [req-5546286c-cf56-4006-bd74-6072113cc1f3 req-37f46218-da62-41f2-8a31-d3234141284b service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Received unexpected event network-vif-unplugged-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 for instance with vm_state deleted and task_state None.
Oct 26 16:06:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-5546286c-cf56-4006-bd74-6072113cc1f3 req-37f46218-da62-41f2-8a31-d3234141284b service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Received event network-vif-plugged-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5546286c-cf56-4006-bd74-6072113cc1f3 req-37f46218-da62-41f2-8a31-d3234141284b service nova] Acquiring lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5546286c-cf56-4006-bd74-6072113cc1f3 req-37f46218-da62-41f2-8a31-d3234141284b service nova] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5546286c-cf56-4006-bd74-6072113cc1f3 req-37f46218-da62-41f2-8a31-d3234141284b service nova] Lock "696aeb6d-33b0-4fd5-9b03-91375b0c30dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-5546286c-cf56-4006-bd74-6072113cc1f3 req-37f46218-da62-41f2-8a31-d3234141284b service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] No waiting events found dispatching network-vif-plugged-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:06:15 user nova-compute[74646]: WARNING nova.compute.manager [req-5546286c-cf56-4006-bd74-6072113cc1f3 req-37f46218-da62-41f2-8a31-d3234141284b service nova] [instance: 696aeb6d-33b0-4fd5-9b03-91375b0c30dc] Received unexpected event network-vif-plugged-e76cc0df-d5d8-4cd5-abf4-cec6e536db86 for instance with vm_state deleted and task_state None.
Oct 26 16:06:16 user nova-compute[74646]: DEBUG nova.objects.instance [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lazy-loading 'flavor' on Instance uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:06:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-e54113a1-a4ce-4fb6-9b51-8e8c5fbf84d0 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.141s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:06:22 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Creating image(s)
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Ensure instance console log exists: /opt/stack/data/nova/instances/b4286998-93f6-439c-9c4e-b710d121420b/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Start _get_guest_xml network_info=[{"id": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "address": "fa:16:3e:5c:cb:d8", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5ab62a-73", "ovs_interfaceid": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '42d38511-a845-4282-a4f4-ac6cf0da921e', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RwVodvCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b4286998-93f6-439c-9c4e-b710d121420b', 'attached_at': '', 'detached_at': '', 'volume_id': '9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b', 'serial': '9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:06:22 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:06:22 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RwVodvCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:06:22 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:06:22 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:06:22 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96a78e3-f327-4fe9-bc60-1283c65cf2be]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:06:22 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3a8444-0d42-40ae-8b9c-8234fd73dfe9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b] added
Oct 26 16:06:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f928405e-ca07-41aa-b4ca-02cd47ec9739]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad73e1ee-7e18-4554-abfe-bffc72d7a20f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RwVodvCe {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RwVodvCe" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[209d2c9d-b43c-4b1e-bec2-98582803931e]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RwVodvCe'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea931e4f-f195-4910-9dbf-1a8a4eb3377f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbebdf13-4959-43bc-895b-3432040f86c0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eea579-6da2-4b96-a40d-273ae1d8b2b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b, portal: 172.16.0.220,3260]
Oct 26 16:06:22 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b, portal: 172.16.0.220,3260] successful.
Oct 26 16:06:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[15da3a50-c02f-4bf4-93b7-708294ff67ea]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[02776b31-9755-42be-b000-e31791a39ac7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:22 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:06:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:22 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:06:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:06:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.077s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e8ec50-549f-45a7-a8d3-a363ac9b98e7]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: None {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RwVodvCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26630396634336636', 'path': '/dev/sdb'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630396634336636', 'path': '/dev/sdb'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1434102605',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1434102605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1434102605',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/PTaUwdDYIS9b5kLFiujpFlEW8yV+g0ZqtGCBJq/cwho7Yy0X8s3VvklYeijfExAgw7Tx2Y6WNH4BVuDQCtlpwmpXaSAuUdbVwnXH28L3+yXrdRSKQ+GUcO4+T1+Fa5Q==',key_name='tempest-keypair-1534934421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-xq57cdli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:05:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9419f9603ca647269ed1cf42e233507f',uuid=b4286998-93f6-439c-9c4e-b710d121420b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "address": "fa:16:3e:5c:cb:d8", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5ab62a-73", "ovs_interfaceid": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "address": "fa:16:3e:5c:cb:d8", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5ab62a-73", "ovs_interfaceid": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=ff5ab62a-73fd-4dcc-90dd-6e5923446b97,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff5ab62a-73') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG nova.objects.instance [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lazy-loading 'pci_devices' on Instance uuid b4286998-93f6-439c-9c4e-b710d121420b {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:06:24 user nova-compute[74646]:   <uuid>b4286998-93f6-439c-9c4e-b710d121420b</uuid>
Oct 26 16:06:24 user nova-compute[74646]:   <name>instance-0000001e</name>
Oct 26 16:06:24 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:06:24 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:06:24 user nova-compute[74646]:   <metadata>
Oct 26 16:06:24 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:06:24 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:06:24 user nova-compute[74646]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1434102605</nova:name>
Oct 26 16:06:24 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:06:22</nova:creationTime>
Oct 26 16:06:24 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:06:24 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:06:24 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:06:24 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:06:24 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:06:24 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:06:24 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:06:24 user nova-compute[74646]:       <nova:owner>
Oct 26 16:06:24 user nova-compute[74646]:         <nova:user uuid="9419f9603ca647269ed1cf42e233507f">tempest-TestVolumeBootPattern-1231840017-project-member</nova:user>
Oct 26 16:06:24 user nova-compute[74646]:         <nova:project uuid="a984c8da90ff476191cd5aa5787032c1">tempest-TestVolumeBootPattern-1231840017</nova:project>
Oct 26 16:06:24 user nova-compute[74646]:       </nova:owner>
Oct 26 16:06:24 user nova-compute[74646]:       <nova:ports>
Oct 26 16:06:24 user nova-compute[74646]:         <nova:port uuid="ff5ab62a-73fd-4dcc-90dd-6e5923446b97">
Oct 26 16:06:24 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 16:06:24 user nova-compute[74646]:         </nova:port>
Oct 26 16:06:24 user nova-compute[74646]:       </nova:ports>
Oct 26 16:06:24 user nova-compute[74646]:     </nova:instance>
Oct 26 16:06:24 user nova-compute[74646]:   </metadata>
Oct 26 16:06:24 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:06:24 user nova-compute[74646]:     <system>
Oct 26 16:06:24 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:06:24 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:06:24 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:06:24 user nova-compute[74646]:       <entry name="serial">b4286998-93f6-439c-9c4e-b710d121420b</entry>
Oct 26 16:06:24 user nova-compute[74646]:       <entry name="uuid">b4286998-93f6-439c-9c4e-b710d121420b</entry>
Oct 26 16:06:24 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:06:24 user nova-compute[74646]:     </system>
Oct 26 16:06:24 user nova-compute[74646]:   </sysinfo>
Oct 26 16:06:24 user nova-compute[74646]:   <os>
Oct 26 16:06:24 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:06:24 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:06:24 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:06:24 user nova-compute[74646]:   </os>
Oct 26 16:06:24 user nova-compute[74646]:   <features>
Oct 26 16:06:24 user nova-compute[74646]:     <acpi/>
Oct 26 16:06:24 user nova-compute[74646]:     <apic/>
Oct 26 16:06:24 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:06:24 user nova-compute[74646]:   </features>
Oct 26 16:06:24 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:06:24 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:06:24 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:06:24 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:06:24 user nova-compute[74646]:   </clock>
Oct 26 16:06:24 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:06:24 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:06:24 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:06:24 user nova-compute[74646]:   </cpu>
Oct 26 16:06:24 user nova-compute[74646]:   <devices>
Oct 26 16:06:24 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:06:24 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:06:24 user nova-compute[74646]:       <source dev="/dev/sdb"/>
Oct 26 16:06:24 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:06:24 user nova-compute[74646]:       <serial>9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b</serial>
Oct 26 16:06:24 user nova-compute[74646]:     </disk>
Oct 26 16:06:24 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:06:24 user nova-compute[74646]:       <mac address="fa:16:3e:5c:cb:d8"/>
Oct 26 16:06:24 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:06:24 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:06:24 user nova-compute[74646]:       <target dev="tapff5ab62a-73"/>
Oct 26 16:06:24 user nova-compute[74646]:     </interface>
Oct 26 16:06:24 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:06:24 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/b4286998-93f6-439c-9c4e-b710d121420b/console.log" append="off"/>
Oct 26 16:06:24 user nova-compute[74646]:     </serial>
Oct 26 16:06:24 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:06:24 user nova-compute[74646]:     <video>
Oct 26 16:06:24 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:06:24 user nova-compute[74646]:     </video>
Oct 26 16:06:24 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:06:24 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:06:24 user nova-compute[74646]:     </rng>
Oct 26 16:06:24 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:06:24 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:06:24 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:06:24 user nova-compute[74646]:     </memballoon>
Oct 26 16:06:24 user nova-compute[74646]:   </devices>
Oct 26 16:06:24 user nova-compute[74646]: </domain>
Oct 26 16:06:24 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1434102605',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1434102605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1434102605',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/PTaUwdDYIS9b5kLFiujpFlEW8yV+g0ZqtGCBJq/cwho7Yy0X8s3VvklYeijfExAgw7Tx2Y6WNH4BVuDQCtlpwmpXaSAuUdbVwnXH28L3+yXrdRSKQ+GUcO4+T1+Fa5Q==',key_name='tempest-keypair-1534934421',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-xq57cdli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:05:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9419f9603ca647269ed1cf42e233507f',uuid=b4286998-93f6-439c-9c4e-b710d121420b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "address": "fa:16:3e:5c:cb:d8", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5ab62a-73", "ovs_interfaceid": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "address": "fa:16:3e:5c:cb:d8", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5ab62a-73", "ovs_interfaceid": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=ff5ab62a-73fd-4dcc-90dd-6e5923446b97,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff5ab62a-73') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG os_vif [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=ff5ab62a-73fd-4dcc-90dd-6e5923446b97,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff5ab62a-73') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '432ad126-70b2-5d01-804e-e6c5de3d4476', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapff5ab62a-73, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapff5ab62a-73, col_values=(('qos', UUID('8379f544-ef58-4c3a-b3ed-9a2c8ed3bf10')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapff5ab62a-73, col_values=(('external_ids', {'iface-id': 'ff5ab62a-73fd-4dcc-90dd-6e5923446b97', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:cb:d8', 'vm-uuid': 'b4286998-93f6-439c-9c4e-b710d121420b'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:24 user nova-compute[74646]: INFO os_vif [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=ff5ab62a-73fd-4dcc-90dd-6e5923446b97,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff5ab62a-73')
Oct 26 16:06:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] No VIF found with MAC fa:16:3e:5c:cb:d8, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:06:24 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:06:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-98d5c2bc-7e0d-45ab-bf7c-d65e24aeed03 req-677a7e1e-c277-4f9d-9e4a-9c1c91bb9391 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Received event network-vif-plugged-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:06:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-98d5c2bc-7e0d-45ab-bf7c-d65e24aeed03 req-677a7e1e-c277-4f9d-9e4a-9c1c91bb9391 service nova] Acquiring lock "b4286998-93f6-439c-9c4e-b710d121420b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-98d5c2bc-7e0d-45ab-bf7c-d65e24aeed03 req-677a7e1e-c277-4f9d-9e4a-9c1c91bb9391 service nova] Lock "b4286998-93f6-439c-9c4e-b710d121420b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-98d5c2bc-7e0d-45ab-bf7c-d65e24aeed03 req-677a7e1e-c277-4f9d-9e4a-9c1c91bb9391 service nova] Lock "b4286998-93f6-439c-9c4e-b710d121420b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-98d5c2bc-7e0d-45ab-bf7c-d65e24aeed03 req-677a7e1e-c277-4f9d-9e4a-9c1c91bb9391 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] No waiting events found dispatching network-vif-plugged-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:06:25 user nova-compute[74646]: WARNING nova.compute.manager [req-98d5c2bc-7e0d-45ab-bf7c-d65e24aeed03 req-677a7e1e-c277-4f9d-9e4a-9c1c91bb9391 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Received unexpected event network-vif-plugged-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 for instance with vm_state building and task_state spawning.
Oct 26 16:06:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:26 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:06:26 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:06:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:06:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:06:27 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Instance spawned successfully.
Oct 26 16:06:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:06:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:06:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:06:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:06:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:06:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:06:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:06:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-056cded8-6441-4721-8c63-2718ade97a9e req-6c67eb69-652f-455a-af87-e8ff604b4fc0 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Received event network-vif-plugged-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:06:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-056cded8-6441-4721-8c63-2718ade97a9e req-6c67eb69-652f-455a-af87-e8ff604b4fc0 service nova] Acquiring lock "b4286998-93f6-439c-9c4e-b710d121420b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-056cded8-6441-4721-8c63-2718ade97a9e req-6c67eb69-652f-455a-af87-e8ff604b4fc0 service nova] Lock "b4286998-93f6-439c-9c4e-b710d121420b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-056cded8-6441-4721-8c63-2718ade97a9e req-6c67eb69-652f-455a-af87-e8ff604b4fc0 service nova] Lock "b4286998-93f6-439c-9c4e-b710d121420b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-056cded8-6441-4721-8c63-2718ade97a9e req-6c67eb69-652f-455a-af87-e8ff604b4fc0 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] No waiting events found dispatching network-vif-plugged-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:06:27 user nova-compute[74646]: WARNING nova.compute.manager [req-056cded8-6441-4721-8c63-2718ade97a9e req-6c67eb69-652f-455a-af87-e8ff604b4fc0 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Received unexpected event network-vif-plugged-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 for instance with vm_state building and task_state spawning.
Oct 26 16:06:27 user nova-compute[74646]: INFO nova.compute.manager [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Took 5.35 seconds to spawn the instance on the hypervisor.
Oct 26 16:06:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:06:28 user nova-compute[74646]: INFO nova.compute.manager [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Took 40.04 seconds to build instance.
Oct 26 16:06:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ad4ce9f0-37e9-47c1-82b2-1136df8a81ea tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "b4286998-93f6-439c-9c4e-b710d121420b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.160s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:28 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:06:28 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:06:28 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:06:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:29 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:06:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:06:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:06:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:06:29 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG nova.objects.instance [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lazy-loading 'flavor' on Instance uuid 9afc1e60-016b-4505-a123-8ec2f4311d84 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Updating instance_info_cache with network_info: [{"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:30 user nova-compute[74646]: INFO nova.compute.manager [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Attaching volume 1cfd75c6-3608-484e-ab17-71d7a115015f to /dev/vdb
Oct 26 16:06:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG os_brick.utils [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eae7e1a-5b00-4144-b4ac-f362253f37b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec59668-2ad8-4567-826a-850db2080347]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ca88f4-cbb7-4668-98f7-9e1a79b24c96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[990caec9-a5f1-43fb-9570-39f7230cf6d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:06:30 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a06f3d6-e00c-4c0a-9277-07ce57f59455]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG os_brick.utils [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Updating existing volume attachment record: 9c1b4af7-74e4-4315-93c5-e3be95d4e7cf {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:06:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:33 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:06:33 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:06:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8098MB free_disk=25.21923065185547GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9afc1e60-016b-4505-a123-8ec2f4311d84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 670508e6-ee5a-4aa9-bb9a-a696205174b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b4286998-93f6-439c-9c4e-b710d121420b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:06:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.552s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:06:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:06:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:35 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:06:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXHQamfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:06:40 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:06:40 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:06:40 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a6cb58-e47a-4d2a-b94c-8162a01df406]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:06:40 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f58b75-b51e-4d59-b9ea-7916de994ced]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481] added
Oct 26 16:06:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ed98fb-4560-4297-adb7-b3de9810fa3c]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbb210b-c875-4ef0-8207-737335dbae9d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXHQamfx {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oXHQamfx" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7702a8b8-b619-42a7-b564-fed4795d329d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oXHQamfx'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eaa675-9ab4-40a6-ae09-fec7f4733cbc]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3950e8-6c80-4c5b-98ce-597549ede04b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:40 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:06:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:40 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:06:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[36d7ebf5-2a80-40ed-a90a-b6b9abbaa8bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481, portal: 172.16.0.220,3260]
Oct 26 16:06:40 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481, portal: 172.16.0.220,3260] successful.
Oct 26 16:06:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef640b1-9bd1-4ee0-9d36-1d44ec42ffd8]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58ecf8c-7b8c-4aa5-8fe2-83d5fcfc4540]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:40 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:06:40 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:06:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:40 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:06:40 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:06:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a008d9-f278-4c7d-89e9-b9f0cb7ac25c]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:06:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXHQamfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:06:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.393s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:06:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '23762343537393834', 'path': '/dev/sdc'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:06:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762343537393834', 'path': '/dev/sdc'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:06:41 user nova-compute[74646]: DEBUG nova.objects.instance [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lazy-loading 'flavor' on Instance uuid 670508e6-ee5a-4aa9-bb9a-a696205174b8 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:06:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:06:41 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:06:41 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 16:06:41 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:06:41 user nova-compute[74646]:   <serial>00d0f839-ae84-49dc-a16f-530f1e9ee481</serial>
Oct 26 16:06:41 user nova-compute[74646]: </disk>
Oct 26 16:06:41 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:06:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:06:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:06:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] No VIF found with MAC fa:16:3e:bf:55:01, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:06:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-35361db0-91d4-48af-a3ff-45472d6c9b65 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.472s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:44 user nova-compute[74646]: DEBUG nova.compute.manager [req-664913f6-5be2-4ae8-a99a-e50b318ee43d req-0892eccc-2689-4cf2-a7dd-b900ef778f0d service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-changed-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:06:44 user nova-compute[74646]: DEBUG nova.compute.manager [req-664913f6-5be2-4ae8-a99a-e50b318ee43d req-0892eccc-2689-4cf2-a7dd-b900ef778f0d service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Refreshing instance network info cache due to event network-changed-54ef776d-25f3-4729-98c1-6ecc9029e55e. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:06:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-664913f6-5be2-4ae8-a99a-e50b318ee43d req-0892eccc-2689-4cf2-a7dd-b900ef778f0d service nova] Acquiring lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:06:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-664913f6-5be2-4ae8-a99a-e50b318ee43d req-0892eccc-2689-4cf2-a7dd-b900ef778f0d service nova] Acquired lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:06:44 user nova-compute[74646]: DEBUG nova.network.neutron [req-664913f6-5be2-4ae8-a99a-e50b318ee43d req-0892eccc-2689-4cf2-a7dd-b900ef778f0d service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Refreshing network info cache for port 54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:06:45 user nova-compute[74646]: DEBUG nova.network.neutron [req-664913f6-5be2-4ae8-a99a-e50b318ee43d req-0892eccc-2689-4cf2-a7dd-b900ef778f0d service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Updated VIF entry in instance network info cache for port 54ef776d-25f3-4729-98c1-6ecc9029e55e. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:06:45 user nova-compute[74646]: DEBUG nova.network.neutron [req-664913f6-5be2-4ae8-a99a-e50b318ee43d req-0892eccc-2689-4cf2-a7dd-b900ef778f0d service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Updating instance_info_cache with network_info: [{"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:06:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-664913f6-5be2-4ae8-a99a-e50b318ee43d req-0892eccc-2689-4cf2-a7dd-b900ef778f0d service nova] Releasing lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:06:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:46 user nova-compute[74646]: DEBUG nova.compute.manager [req-f607ce7a-f395-473c-868b-ce32ea4d484f req-26b9dfd1-7722-4eec-9373-32eee7ee1449 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-changed-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:06:46 user nova-compute[74646]: DEBUG nova.compute.manager [req-f607ce7a-f395-473c-868b-ce32ea4d484f req-26b9dfd1-7722-4eec-9373-32eee7ee1449 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Refreshing instance network info cache due to event network-changed-54ef776d-25f3-4729-98c1-6ecc9029e55e. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:06:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f607ce7a-f395-473c-868b-ce32ea4d484f req-26b9dfd1-7722-4eec-9373-32eee7ee1449 service nova] Acquiring lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:06:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f607ce7a-f395-473c-868b-ce32ea4d484f req-26b9dfd1-7722-4eec-9373-32eee7ee1449 service nova] Acquired lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:06:46 user nova-compute[74646]: DEBUG nova.network.neutron [req-f607ce7a-f395-473c-868b-ce32ea4d484f req-26b9dfd1-7722-4eec-9373-32eee7ee1449 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Refreshing network info cache for port 54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:06:47 user nova-compute[74646]: DEBUG nova.network.neutron [req-f607ce7a-f395-473c-868b-ce32ea4d484f req-26b9dfd1-7722-4eec-9373-32eee7ee1449 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Updated VIF entry in instance network info cache for port 54ef776d-25f3-4729-98c1-6ecc9029e55e. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:06:47 user nova-compute[74646]: DEBUG nova.network.neutron [req-f607ce7a-f395-473c-868b-ce32ea4d484f req-26b9dfd1-7722-4eec-9373-32eee7ee1449 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Updating instance_info_cache with network_info: [{"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:06:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f607ce7a-f395-473c-868b-ce32ea4d484f req-26b9dfd1-7722-4eec-9373-32eee7ee1449 service nova] Releasing lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:06:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-49b791b2-b112-4def-8428-b9876996dcc5 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-49b791b2-b112-4def-8428-b9876996dcc5 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:47 user nova-compute[74646]: INFO nova.compute.manager [None req-49b791b2-b112-4def-8428-b9876996dcc5 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Rebooting instance
Oct 26 16:06:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-49b791b2-b112-4def-8428-b9876996dcc5 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:06:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-49b791b2-b112-4def-8428-b9876996dcc5 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquired lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:06:47 user nova-compute[74646]: DEBUG nova.network.neutron [None req-49b791b2-b112-4def-8428-b9876996dcc5 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:06:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-49b791b2-b112-4def-8428-b9876996dcc5 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Updating instance_info_cache with network_info: [{"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:06:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-49b791b2-b112-4def-8428-b9876996dcc5 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Releasing lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:06:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-49b791b2-b112-4def-8428-b9876996dcc5 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:06:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-c334ce60-9f9f-471b-8614-22a3858364f1 req-7b3015d1-4189-46c6-b473-f93bcd370d57 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-vif-unplugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:06:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c334ce60-9f9f-471b-8614-22a3858364f1 req-7b3015d1-4189-46c6-b473-f93bcd370d57 service nova] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c334ce60-9f9f-471b-8614-22a3858364f1 req-7b3015d1-4189-46c6-b473-f93bcd370d57 service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c334ce60-9f9f-471b-8614-22a3858364f1 req-7b3015d1-4189-46c6-b473-f93bcd370d57 service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-c334ce60-9f9f-471b-8614-22a3858364f1 req-7b3015d1-4189-46c6-b473-f93bcd370d57 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] No waiting events found dispatching network-vif-unplugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:06:50 user nova-compute[74646]: WARNING nova.compute.manager [req-c334ce60-9f9f-471b-8614-22a3858364f1 req-7b3015d1-4189-46c6-b473-f93bcd370d57 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received unexpected event network-vif-unplugged-54ef776d-25f3-4729-98c1-6ecc9029e55e for instance with vm_state active and task_state reboot_started.
Oct 26 16:06:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:51 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-49b791b2-b112-4def-8428-b9876996dcc5 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Instance shutdown successfully.
Oct 26 16:06:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqRwDLfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:06:51 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:06:51 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:06:51 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c020685-72b0-416b-a4d0-3ec70a6c8f40]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:06:51 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[91dd9e84-dbde-435e-b0f8-f5c9f1aafadb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f] added
Oct 26 16:06:51 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bfaf56-5893-4d10-8b26-59ddc0f379fb]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faa3e5c-cfaa-4248-9b0b-18f3584e0002]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CqRwDLfK {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CqRwDLfK" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3372d188-12e3-4a07-988b-3971fa0ed17b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CqRwDLfK'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[309ba9c1-bbe8-42ba-809b-0839aa431009]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb638c3c-1169-489b-890a-ad730f1dad86]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:51 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:06:51 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:06:51 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:51 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:06:51 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:06:51 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d46fd36-5002-4af0-a0e3-cc41923d98c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f, portal: 172.16.0.220,3260]
Oct 26 16:06:51 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f, portal: 172.16.0.220,3260] successful.
Oct 26 16:06:51 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6d6d0a-b0e9-49b6-82e7-0546f16fb5ae]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59cb063-78ac-41b7-854f-75c78887e074]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:51 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:06:51 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:06:51 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:06:51 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:51 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:06:51 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:06:51 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:06:51 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6788f8-771e-4e28-b13d-936075fc05e9]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:06:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqRwDLfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:06:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:06:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] <== connect_volume: return (1438ms) {'type': 'block', 'scsi_wwn': '26531343330346266', 'path': '/dev/sdd'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:06:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531343330346266', 'path': '/dev/sdd'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:06:52 user nova-compute[74646]: DEBUG nova.objects.instance [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lazy-loading 'flavor' on Instance uuid 9afc1e60-016b-4505-a123-8ec2f4311d84 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:06:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-cd7bd037-b7a7-4750-a771-f33ce9425f9a req-dfcd8b8d-e4e6-4d6a-bc0d-49075fb8f3c6 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:06:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cd7bd037-b7a7-4750-a771-f33ce9425f9a req-dfcd8b8d-e4e6-4d6a-bc0d-49075fb8f3c6 service nova] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cd7bd037-b7a7-4750-a771-f33ce9425f9a req-dfcd8b8d-e4e6-4d6a-bc0d-49075fb8f3c6 service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cd7bd037-b7a7-4750-a771-f33ce9425f9a req-dfcd8b8d-e4e6-4d6a-bc0d-49075fb8f3c6 service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-cd7bd037-b7a7-4750-a771-f33ce9425f9a req-dfcd8b8d-e4e6-4d6a-bc0d-49075fb8f3c6 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] No waiting events found dispatching network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:06:52 user nova-compute[74646]: WARNING nova.compute.manager [req-cd7bd037-b7a7-4750-a771-f33ce9425f9a req-dfcd8b8d-e4e6-4d6a-bc0d-49075fb8f3c6 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received unexpected event network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e for instance with vm_state active and task_state reboot_started.
Oct 26 16:06:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:06:52 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:06:52 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:06:52 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:06:52 user nova-compute[74646]:   <serial>1cfd75c6-3608-484e-ab17-71d7a115015f</serial>
Oct 26 16:06:52 user nova-compute[74646]: </disk>
Oct 26 16:06:52 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:06:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:06:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:06:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] No VIF found with MAC fa:16:3e:d3:2a:b2, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:06:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1d60cea8-7cdf-47d1-b2bb-5ee1c7244140 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 23.417s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:54 user nova-compute[74646]: INFO nova.compute.manager [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Rescuing
Oct 26 16:06:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:06:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquired lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:06:54 user nova-compute[74646]: DEBUG nova.network.neutron [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-2d3cd1d0-c796-4f42-ae77-edb95874ed1f req-aa71af93-ca7e-4f83-9430-ff5607e7ec7a service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2d3cd1d0-c796-4f42-ae77-edb95874ed1f req-aa71af93-ca7e-4f83-9430-ff5607e7ec7a service nova] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2d3cd1d0-c796-4f42-ae77-edb95874ed1f req-aa71af93-ca7e-4f83-9430-ff5607e7ec7a service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2d3cd1d0-c796-4f42-ae77-edb95874ed1f req-aa71af93-ca7e-4f83-9430-ff5607e7ec7a service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-2d3cd1d0-c796-4f42-ae77-edb95874ed1f req-aa71af93-ca7e-4f83-9430-ff5607e7ec7a service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] No waiting events found dispatching network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:06:55 user nova-compute[74646]: WARNING nova.compute.manager [req-2d3cd1d0-c796-4f42-ae77-edb95874ed1f req-aa71af93-ca7e-4f83-9430-ff5607e7ec7a service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received unexpected event network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e for instance with vm_state active and task_state reboot_started.
Oct 26 16:06:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-2d3cd1d0-c796-4f42-ae77-edb95874ed1f req-aa71af93-ca7e-4f83-9430-ff5607e7ec7a service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2d3cd1d0-c796-4f42-ae77-edb95874ed1f req-aa71af93-ca7e-4f83-9430-ff5607e7ec7a service nova] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2d3cd1d0-c796-4f42-ae77-edb95874ed1f req-aa71af93-ca7e-4f83-9430-ff5607e7ec7a service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2d3cd1d0-c796-4f42-ae77-edb95874ed1f req-aa71af93-ca7e-4f83-9430-ff5607e7ec7a service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-2d3cd1d0-c796-4f42-ae77-edb95874ed1f req-aa71af93-ca7e-4f83-9430-ff5607e7ec7a service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] No waiting events found dispatching network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:06:55 user nova-compute[74646]: WARNING nova.compute.manager [req-2d3cd1d0-c796-4f42-ae77-edb95874ed1f req-aa71af93-ca7e-4f83-9430-ff5607e7ec7a service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received unexpected event network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e for instance with vm_state active and task_state reboot_started.
Oct 26 16:06:55 user nova-compute[74646]: DEBUG nova.network.neutron [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Updating instance_info_cache with network_info: [{"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Releasing lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:55 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Instance running successfully.
Oct 26 16:06:55 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-49b791b2-b112-4def-8428-b9876996dcc5 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Instance soft rebooted successfully.
Oct 26 16:06:55 user nova-compute[74646]: DEBUG nova.compute.manager [None req-49b791b2-b112-4def-8428-b9876996dcc5 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:06:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-49b791b2-b112-4def-8428-b9876996dcc5 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.048s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:56 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Instance destroyed successfully.
Oct 26 16:06:56 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Attempting a stable device rescue
Oct 26 16:06:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74646) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 16:06:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Instance directory exists: not creating {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 16:06:56 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Creating image(s)
Oct 26 16:06:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "/opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "/opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "/opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:56 user nova-compute[74646]: DEBUG nova.objects.instance [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lazy-loading 'trusted_certs' on Instance uuid 9afc1e60-016b-4505-a123-8ec2f4311d84 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:06:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "d60c2fd3f60ef06b3fadffe951d59015c0831b3b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "d60c2fd3f60ef06b3fadffe951d59015c0831b3b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60c2fd3f60ef06b3fadffe951d59015c0831b3b.part --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-589a9990-48d6-4b73-80e6-07688e70141b req-9d2536cc-b82f-4652-9205-a229fbca461b service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-vif-unplugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:06:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-589a9990-48d6-4b73-80e6-07688e70141b req-9d2536cc-b82f-4652-9205-a229fbca461b service nova] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-589a9990-48d6-4b73-80e6-07688e70141b req-9d2536cc-b82f-4652-9205-a229fbca461b service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-589a9990-48d6-4b73-80e6-07688e70141b req-9d2536cc-b82f-4652-9205-a229fbca461b service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-589a9990-48d6-4b73-80e6-07688e70141b req-9d2536cc-b82f-4652-9205-a229fbca461b service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] No waiting events found dispatching network-vif-unplugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:06:57 user nova-compute[74646]: WARNING nova.compute.manager [req-589a9990-48d6-4b73-80e6-07688e70141b req-9d2536cc-b82f-4652-9205-a229fbca461b service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received unexpected event network-vif-unplugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a for instance with vm_state active and task_state rescuing.
Oct 26 16:06:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-589a9990-48d6-4b73-80e6-07688e70141b req-9d2536cc-b82f-4652-9205-a229fbca461b service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:06:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-589a9990-48d6-4b73-80e6-07688e70141b req-9d2536cc-b82f-4652-9205-a229fbca461b service nova] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-589a9990-48d6-4b73-80e6-07688e70141b req-9d2536cc-b82f-4652-9205-a229fbca461b service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-589a9990-48d6-4b73-80e6-07688e70141b req-9d2536cc-b82f-4652-9205-a229fbca461b service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-589a9990-48d6-4b73-80e6-07688e70141b req-9d2536cc-b82f-4652-9205-a229fbca461b service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] No waiting events found dispatching network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:06:57 user nova-compute[74646]: WARNING nova.compute.manager [req-589a9990-48d6-4b73-80e6-07688e70141b req-9d2536cc-b82f-4652-9205-a229fbca461b service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received unexpected event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a for instance with vm_state active and task_state rescuing.
Oct 26 16:06:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60c2fd3f60ef06b3fadffe951d59015c0831b3b.part --force-share --output=json" returned: 0 in 0.203s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:57 user nova-compute[74646]: DEBUG nova.virt.images [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] 9ef7157f-1860-40d9-b56c-1a42f271d219 was qcow2, converting to raw {{(pid=74646) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 16:06:57 user nova-compute[74646]: DEBUG nova.privsep.utils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74646) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 16:06:57 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d60c2fd3f60ef06b3fadffe951d59015c0831b3b.part /opt/stack/data/nova/instances/_base/d60c2fd3f60ef06b3fadffe951d59015c0831b3b.converted {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d60c2fd3f60ef06b3fadffe951d59015c0831b3b.part /opt/stack/data/nova/instances/_base/d60c2fd3f60ef06b3fadffe951d59015c0831b3b.converted" returned: 0 in 0.570s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60c2fd3f60ef06b3fadffe951d59015c0831b3b.converted --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60c2fd3f60ef06b3fadffe951d59015c0831b3b.converted --force-share --output=json" returned: 0 in 0.238s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "d60c2fd3f60ef06b3fadffe951d59015c0831b3b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.362s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "d60c2fd3f60ef06b3fadffe951d59015c0831b3b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "d60c2fd3f60ef06b3fadffe951d59015c0831b3b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60c2fd3f60ef06b3fadffe951d59015c0831b3b --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d60c2fd3f60ef06b3fadffe951d59015c0831b3b --force-share --output=json" returned: 0 in 0.212s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d60c2fd3f60ef06b3fadffe951d59015c0831b3b,backing_fmt=raw /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.rescue {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d60c2fd3f60ef06b3fadffe951d59015c0831b3b,backing_fmt=raw /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.rescue" returned: 0 in 0.053s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "d60c2fd3f60ef06b3fadffe951d59015c0831b3b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.objects.instance [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lazy-loading 'migration_context' on Instance uuid 9afc1e60-016b-4505-a123-8ec2f4311d84 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.objects.base [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Object Instance<9afc1e60-016b-4505-a123-8ec2f4311d84> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Start _get_guest_xml network_info=[{"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "vif_mac": "fa:16:3e:d3:2a:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '9ef7157f-1860-40d9-b56c-1a42f271d219', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': None, 'mount_device': '/dev/vdb', 'attachment_id': '9c1b4af7-74e4-4315-93c5-e3be95d4e7cf', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqRwDLfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '9afc1e60-016b-4505-a123-8ec2f4311d84', 'attached_at': '', 'detached_at': '', 'volume_id': '1cfd75c6-3608-484e-ab17-71d7a115015f', 'serial': '1cfd75c6-3608-484e-ab17-71d7a115015f'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.objects.instance [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lazy-loading 'resources' on Instance uuid 9afc1e60-016b-4505-a123-8ec2f4311d84 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.objects.base [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Object Instance<9afc1e60-016b-4505-a123-8ec2f4311d84> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.objects.instance [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lazy-loading 'numa_topology' on Instance uuid 9afc1e60-016b-4505-a123-8ec2f4311d84 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.objects.base [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Object Instance<9afc1e60-016b-4505-a123-8ec2f4311d84> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:06:58 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:06:58 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:06:58 user nova-compute[74646]: DEBUG nova.objects.instance [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lazy-loading 'vcpu_model' on Instance uuid 9afc1e60-016b-4505-a123-8ec2f4311d84 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG nova.objects.base [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Object Instance<9afc1e60-016b-4505-a123-8ec2f4311d84> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqRwDLfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:06:59 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:06:59 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:06:59 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0ff699-0d25-4cc2-9981-f5d5b954b880]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = CqRwDLfK\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 16:06:59 user nova-compute[74646]: node.name = iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f
Oct 26 16:06:59 user nova-compute[74646]: node.tpgt = -1
Oct 26 16:06:59 user nova-compute[74646]: node.startup = automatic
Oct 26 16:06:59 user nova-compute[74646]: node.leading_login = No
Oct 26 16:06:59 user nova-compute[74646]: iface.iscsi_ifacename = default
Oct 26 16:06:59 user nova-compute[74646]: iface.net_ifacename = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.ipaddress = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.prefix_len = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.hwaddress = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.transport_name = tcp
Oct 26 16:06:59 user nova-compute[74646]: iface.initiatorname = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.state = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.vlan_id = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.vlan_priority = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.vlan_state = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.iface_num = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.mtu = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.port = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.bootproto = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.subnet_mask = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.gateway = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.dhcp_alt_client_id = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.dhcp_dns = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.dhcp_learn_iqn = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.dhcp_vendor_id_state = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.dhcp_vendor_id = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.dhcp_slp_da = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.fragmentation = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.gratuitous_arp = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.incoming_forwarding = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.tos_state = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.tos = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.ttl = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.delayed_ack = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.tcp_nagle = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.tcp_wsf_state = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.tcp_wsf = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.tcp_timer_scale = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.tcp_timestamp = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.redirect = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.def_task_mgmt_timeout = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.header_digest = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.data_digest = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.immediate_data = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.initial_r2t = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.data_seq_inorder = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.data_pdu_inorder = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.erl = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.max_receive_data_len = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.first_burst_len = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.max_outstanding_r2t = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.max_burst_len = 0
Oct 26 16:06:59 user nova-compute[74646]: iface.chap_auth = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.bidi_chap = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.strict_login_compliance = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.discovery_auth = <empty>
Oct 26 16:06:59 user nova-compute[74646]: iface.discovery_logout = <empty>
Oct 26 16:06:59 user nova-compute[74646]: node.discovery_address = <empty>
Oct 26 16:06:59 user nova-compute[74646]: node.discovery_port = 0
Oct 26 16:06:59 user nova-compute[74646]: node.discovery_type = static
Oct 26 16:06:59 user nova-compute[74646]: node.session.initial_cmdsn = 0
Oct 26 16:06:59 user nova-compute[74646]: node.session.initial_login_retry_max = 8
Oct 26 16:06:59 user nova-compute[74646]: node.session.xmit_thread_priority = -20
Oct 26 16:06:59 user nova-compute[74646]: node.session.cmds_max = 128
Oct 26 16:06:59 user nova-compute[74646]: node.session.queue_depth = 32
Oct 26 16:06:59 user nova-compute[74646]: node.session.nr_sessions = 1
Oct 26 16:06:59 user nova-compute[74646]: node.session.auth.authmethod = CHAP
Oct 26 16:06:59 user nova-compute[74646]: node.session.auth.username = CqRwDLfK
Oct 26 16:06:59 user nova-compute[74646]: node.session.auth.password = ***
Oct 26 16:06:59 user nova-compute[74646]: node.session.auth.username_in = <empty>
Oct 26 16:06:59 user nova-compute[74646]: node.session.auth.password_in = <empty>
Oct 26 16:06:59 user nova-compute[74646]: node.session.auth.chap_algs = MD5
Oct 26 16:06:59 user nova-compute[74646]: node.session.timeo.replacement_timeout = 120
Oct 26 16:06:59 user nova-compute[74646]: node.session.err_timeo.abort_timeout = 15
Oct 26 16:06:59 user nova-compute[74646]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 16:06:59 user nova-compute[74646]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 16:06:59 user nova-compute[74646]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 16:06:59 user nova-compute[74646]: node.session.iscsi.FastAbort = Yes
Oct 26 16:06:59 user nova-compute[74646]: node.session.iscsi.InitialR2T = No
Oct 26 16:06:59 user nova-compute[74646]: node.session.iscsi.ImmediateData = Yes
Oct 26 16:06:59 user nova-compute[74646]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 16:06:59 user nova-compute[74646]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 16:06:59 user nova-compute[74646]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 16:06:59 user nova-compute[74646]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 16:06:59 user nova-compute[74646]: node.session.iscsi.MaxConnections = 1
Oct 26 16:06:59 user nova-compute[74646]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 16:06:59 user nova-compute[74646]: node.session.iscsi.ERL = 0
Oct 26 16:06:59 user nova-compute[74646]: node.session.scan = manual
Oct 26 16:06:59 user nova-compute[74646]: node.session.reopen_max = 0
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].address = 172.16.0.220
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].port = 3260
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].startup = manual
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].tcp.window_size = 524288
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].tcp.type_of_service = 0
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].timeo.logout_timeout = 15
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].timeo.login_timeout = 15
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].timeo.auth_timeout = 45
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].iscsi.DataDigest = None
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].iscsi.IFMarker = No
Oct 26 16:06:59 user nova-compute[74646]: node.conn[0].iscsi.OFMarker = No
Oct 26 16:06:59 user nova-compute[74646]: # END RECORD
Oct 26 16:06:59 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac06e70-3cae-4b38-8753-9b2286ebac2e]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7691400c-4687-44eb-bbee-415b620a68cb]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CqRwDLfK {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CqRwDLfK" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a089654d-92a1-4d02-9e24-7b9506407e02]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CqRwDLfK'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ac8408-7b2e-4d7d-be43-370b18f11d73]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e1c5b5-0e2f-47c5-a49e-6ae4d5467b2c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:59 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:06:59 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:06:59 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:06:59 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:06:59 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:06:59 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:06:59 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:06:59 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.168s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] HCTL ('35', '0', '0', 0) found on session 36 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1439425d-90c7-428e-95c8-b09abcf515ef]: (4, ('0 0 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Searching for a device in session 36 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqRwDLfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '26531343330346266', 'path': '/dev/sdd'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531343330346266', 'path': '/dev/sdd'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1818110104',display_name='tempest-ServerStableDeviceRescueTest-server-1818110104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1818110104',id=28,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsDVhutifjQH2fs3DJ9owCuxkPwhwBPKRt1WQ/uin9Ku9P4syVZ+tiG3bU+0TOwcMRKMrI6BoQrpoCH9bZ+c7DabwfLKDBwpYQV5HRbOJ2LXumMCWgL0Z33FIh6FgHCug==',key_name='tempest-keypair-1985130805',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:02:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec5750bffd274d89bc32c0aea139061c',ramdisk_id='',reservation_id='r-ogxyw4vr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-399818180',owner_user_name='tempest-ServerStableDeviceRescueTest-399818180-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:04:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f53e1b1d3d84c48b1ea84480b83aa71',uuid=9afc1e60-016b-4505-a123-8ec2f4311d84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "vif_mac": "fa:16:3e:d3:2a:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Converting VIF {"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "vif_mac": "fa:16:3e:d3:2a:b2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:2a:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ac5e586-1f3c-4057-8e24-73a8d6de614a,network=Network(7cf97893-1b8b-4791-8477-53c16f8923a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac5e586-1f') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG nova.objects.instance [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lazy-loading 'pci_devices' on Instance uuid 9afc1e60-016b-4505-a123-8ec2f4311d84 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG nova.objects.base [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Object Instance<9afc1e60-016b-4505-a123-8ec2f4311d84> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:06:59 user nova-compute[74646]:   <uuid>9afc1e60-016b-4505-a123-8ec2f4311d84</uuid>
Oct 26 16:06:59 user nova-compute[74646]:   <name>instance-0000001c</name>
Oct 26 16:06:59 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:06:59 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:06:59 user nova-compute[74646]:   <metadata>
Oct 26 16:06:59 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:06:59 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:06:59 user nova-compute[74646]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1818110104</nova:name>
Oct 26 16:06:59 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:06:58</nova:creationTime>
Oct 26 16:06:59 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:06:59 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:06:59 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:06:59 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:06:59 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:06:59 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:06:59 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:06:59 user nova-compute[74646]:       <nova:owner>
Oct 26 16:06:59 user nova-compute[74646]:         <nova:user uuid="2f53e1b1d3d84c48b1ea84480b83aa71">tempest-ServerStableDeviceRescueTest-399818180-project-member</nova:user>
Oct 26 16:06:59 user nova-compute[74646]:         <nova:project uuid="ec5750bffd274d89bc32c0aea139061c">tempest-ServerStableDeviceRescueTest-399818180</nova:project>
Oct 26 16:06:59 user nova-compute[74646]:       </nova:owner>
Oct 26 16:06:59 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:06:59 user nova-compute[74646]:       <nova:ports>
Oct 26 16:06:59 user nova-compute[74646]:         <nova:port uuid="6ac5e586-1f3c-4057-8e24-73a8d6de614a">
Oct 26 16:06:59 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 16:06:59 user nova-compute[74646]:         </nova:port>
Oct 26 16:06:59 user nova-compute[74646]:       </nova:ports>
Oct 26 16:06:59 user nova-compute[74646]:     </nova:instance>
Oct 26 16:06:59 user nova-compute[74646]:   </metadata>
Oct 26 16:06:59 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:06:59 user nova-compute[74646]:     <system>
Oct 26 16:06:59 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:06:59 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:06:59 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:06:59 user nova-compute[74646]:       <entry name="serial">9afc1e60-016b-4505-a123-8ec2f4311d84</entry>
Oct 26 16:06:59 user nova-compute[74646]:       <entry name="uuid">9afc1e60-016b-4505-a123-8ec2f4311d84</entry>
Oct 26 16:06:59 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:06:59 user nova-compute[74646]:     </system>
Oct 26 16:06:59 user nova-compute[74646]:   </sysinfo>
Oct 26 16:06:59 user nova-compute[74646]:   <os>
Oct 26 16:06:59 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:06:59 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:06:59 user nova-compute[74646]:   </os>
Oct 26 16:06:59 user nova-compute[74646]:   <features>
Oct 26 16:06:59 user nova-compute[74646]:     <acpi/>
Oct 26 16:06:59 user nova-compute[74646]:     <apic/>
Oct 26 16:06:59 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:06:59 user nova-compute[74646]:   </features>
Oct 26 16:06:59 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:06:59 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:06:59 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:06:59 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:06:59 user nova-compute[74646]:   </clock>
Oct 26 16:06:59 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:06:59 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:06:59 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:06:59 user nova-compute[74646]:   </cpu>
Oct 26 16:06:59 user nova-compute[74646]:   <devices>
Oct 26 16:06:59 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:06:59 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:06:59 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk"/>
Oct 26 16:06:59 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:06:59 user nova-compute[74646]:     </disk>
Oct 26 16:06:59 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:06:59 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:06:59 user nova-compute[74646]:       <source dev="/dev/sdd"/>
Oct 26 16:06:59 user nova-compute[74646]:       <target dev="vdb" bus="virtio"/>
Oct 26 16:06:59 user nova-compute[74646]:       <serial>1cfd75c6-3608-484e-ab17-71d7a115015f</serial>
Oct 26 16:06:59 user nova-compute[74646]:     </disk>
Oct 26 16:06:59 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:06:59 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:06:59 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.rescue"/>
Oct 26 16:06:59 user nova-compute[74646]:       <target dev="vdc" bus="virtio"/>
Oct 26 16:06:59 user nova-compute[74646]:       <boot order="1"/>
Oct 26 16:06:59 user nova-compute[74646]:     </disk>
Oct 26 16:06:59 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:06:59 user nova-compute[74646]:       <mac address="fa:16:3e:d3:2a:b2"/>
Oct 26 16:06:59 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:06:59 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:06:59 user nova-compute[74646]:       <target dev="tap6ac5e586-1f"/>
Oct 26 16:06:59 user nova-compute[74646]:     </interface>
Oct 26 16:06:59 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:06:59 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/console.log" append="off"/>
Oct 26 16:06:59 user nova-compute[74646]:     </serial>
Oct 26 16:06:59 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:06:59 user nova-compute[74646]:     <video>
Oct 26 16:06:59 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:06:59 user nova-compute[74646]:     </video>
Oct 26 16:06:59 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:06:59 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:06:59 user nova-compute[74646]:     </rng>
Oct 26 16:06:59 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:06:59 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:06:59 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:06:59 user nova-compute[74646]:     </memballoon>
Oct 26 16:06:59 user nova-compute[74646]:   </devices>
Oct 26 16:06:59 user nova-compute[74646]: </domain>
Oct 26 16:06:59 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:06:59 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Instance destroyed successfully.
Oct 26 16:06:59 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:06:59 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] No VIF found with MAC fa:16:3e:d3:2a:b2, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:07:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-c24cba9c-5555-451c-bf28-a3d5f22da162 req-90428c6f-68ba-43ca-a0fd-f66125264083 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:07:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c24cba9c-5555-451c-bf28-a3d5f22da162 req-90428c6f-68ba-43ca-a0fd-f66125264083 service nova] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c24cba9c-5555-451c-bf28-a3d5f22da162 req-90428c6f-68ba-43ca-a0fd-f66125264083 service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c24cba9c-5555-451c-bf28-a3d5f22da162 req-90428c6f-68ba-43ca-a0fd-f66125264083 service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-c24cba9c-5555-451c-bf28-a3d5f22da162 req-90428c6f-68ba-43ca-a0fd-f66125264083 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] No waiting events found dispatching network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:07:01 user nova-compute[74646]: WARNING nova.compute.manager [req-c24cba9c-5555-451c-bf28-a3d5f22da162 req-90428c6f-68ba-43ca-a0fd-f66125264083 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received unexpected event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a for instance with vm_state active and task_state rescuing.
Oct 26 16:07:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:03 user nova-compute[74646]: DEBUG nova.compute.manager [req-1743e5bf-7c12-489c-b31f-ac6eb010d533 req-18611e13-1e5c-4405-a9e1-0794cce79266 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:07:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1743e5bf-7c12-489c-b31f-ac6eb010d533 req-18611e13-1e5c-4405-a9e1-0794cce79266 service nova] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1743e5bf-7c12-489c-b31f-ac6eb010d533 req-18611e13-1e5c-4405-a9e1-0794cce79266 service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1743e5bf-7c12-489c-b31f-ac6eb010d533 req-18611e13-1e5c-4405-a9e1-0794cce79266 service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:03 user nova-compute[74646]: DEBUG nova.compute.manager [req-1743e5bf-7c12-489c-b31f-ac6eb010d533 req-18611e13-1e5c-4405-a9e1-0794cce79266 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] No waiting events found dispatching network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:07:03 user nova-compute[74646]: WARNING nova.compute.manager [req-1743e5bf-7c12-489c-b31f-ac6eb010d533 req-18611e13-1e5c-4405-a9e1-0794cce79266 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received unexpected event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a for instance with vm_state active and task_state rescuing.
Oct 26 16:07:03 user nova-compute[74646]: DEBUG nova.compute.manager [None req-7ff1a0d2-e2fc-4dd4-8d0d-5c8382c59eb3 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:07:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:07:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 16:07:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:07:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:07:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "9e46d857-97e1-40a0-9232-57438a82f8c6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:07:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:15 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:07:15 user nova-compute[74646]: INFO nova.compute.claims [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Claim successful on node user
Oct 26 16:07:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:07:16 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:07:16 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG nova.policy [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9311cee7c04e45ddbae6f16ba43eed2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c8788e95cc244f98b0ff8d593d1e067', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:07:16 user nova-compute[74646]: INFO nova.virt.block_device [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Booting with volume eb9b9e63-b7e0-464b-b69f-aeac55c6d126 at /dev/vda
Oct 26 16:07:16 user nova-compute[74646]: DEBUG os_brick.utils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ec5465-db5b-49ac-ac2a-fb631a9430d8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf78ce7-e1f8-47c2-a88b-ffe5afced3d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61f28fb-401f-4d64-90fa-c3ac985ea1e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d319778-dc90-41ff-b55d-c5856ee9754c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:07:16 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:07:16 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55cd0e8-9430-4a28-83ef-8a5340c8f59b]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG os_brick.utils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:07:16 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updating existing volume attachment record: 2a8018ec-3104-46ee-9d0b-90664f324407 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:07:17 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Successfully created port: 898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:07:18 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Successfully updated port: 898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:07:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:07:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquired lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:07:18 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:07:18 user nova-compute[74646]: DEBUG nova.compute.manager [req-e2080ff5-fb18-4787-9358-8f89b0b47d13 req-9ee15fcb-0c3d-4daa-a243-6dceddc351e8 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received event network-changed-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:07:18 user nova-compute[74646]: DEBUG nova.compute.manager [req-e2080ff5-fb18-4787-9358-8f89b0b47d13 req-9ee15fcb-0c3d-4daa-a243-6dceddc351e8 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Refreshing instance network info cache due to event network-changed-898eb4a5-708b-4414-bc27-1413e1a1d978. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:07:18 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e2080ff5-fb18-4787-9358-8f89b0b47d13 req-9ee15fcb-0c3d-4daa-a243-6dceddc351e8 service nova] Acquiring lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:07:18 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:07:19 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updating instance_info_cache with network_info: [{"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:07:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Releasing lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:07:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Instance network_info: |[{"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:07:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e2080ff5-fb18-4787-9358-8f89b0b47d13 req-9ee15fcb-0c3d-4daa-a243-6dceddc351e8 service nova] Acquired lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:07:19 user nova-compute[74646]: DEBUG nova.network.neutron [req-e2080ff5-fb18-4787-9358-8f89b0b47d13 req-9ee15fcb-0c3d-4daa-a243-6dceddc351e8 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Refreshing network info cache for port 898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:07:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:19 user nova-compute[74646]: DEBUG nova.network.neutron [req-e2080ff5-fb18-4787-9358-8f89b0b47d13 req-9ee15fcb-0c3d-4daa-a243-6dceddc351e8 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updated VIF entry in instance network info cache for port 898eb4a5-708b-4414-bc27-1413e1a1d978. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:07:19 user nova-compute[74646]: DEBUG nova.network.neutron [req-e2080ff5-fb18-4787-9358-8f89b0b47d13 req-9ee15fcb-0c3d-4daa-a243-6dceddc351e8 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updating instance_info_cache with network_info: [{"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:07:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e2080ff5-fb18-4787-9358-8f89b0b47d13 req-9ee15fcb-0c3d-4daa-a243-6dceddc351e8 service nova] Releasing lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:07:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:25 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:07:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:28 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:07:28 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:07:28 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:07:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:29 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:07:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:07:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Didn't find any instances for network info cache update. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 16:07:29 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:07:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:29 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:07:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:07:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:07:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.rescue --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.rescue --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:07:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:07:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:32 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:07:32 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:07:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7965MB free_disk=25.10811996459961GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:07:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:07:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:07:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:07:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:07:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9afc1e60-016b-4505-a123-8ec2f4311d84 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:07:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 670508e6-ee5a-4aa9-bb9a-a696205174b8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:07:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b4286998-93f6-439c-9c4e-b710d121420b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:07:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9e46d857-97e1-40a0-9232-57438a82f8c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:07:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:07:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:07:33 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:07:33 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:07:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:07:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.568s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:07:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:07:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:07:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "511f84be-7779-4856-8611-9171c1b59d58" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "511f84be-7779-4856-8611-9171c1b59d58" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:07:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:35 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:07:35 user nova-compute[74646]: INFO nova.compute.claims [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Claim successful on node user
Oct 26 16:07:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG nova.compute.manager [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG nova.compute.manager [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG nova.network.neutron [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:07:36 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:07:36 user nova-compute[74646]: DEBUG nova.compute.manager [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG nova.compute.manager [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:07:36 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Creating image(s)
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "/opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "/opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "/opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG nova.policy [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abd7a869c235467ca4da99867c6bc0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e848952345455183c15fee816b6f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.253s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.195s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk 1073741824" returned: 0 in 0.075s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.227s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:37 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Checking if we can resize image /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:07:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:37 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Cannot resize image /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:07:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:07:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Ensure instance console log exists: /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:07:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:38 user nova-compute[74646]: DEBUG nova.network.neutron [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Successfully created port: 948b856f-3b22-4614-96ca-7349cf1b9343 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:07:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:07:39 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Creating image(s)
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Ensure instance console log exists: /opt/stack/data/nova/instances/9e46d857-97e1-40a0-9232-57438a82f8c6/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Start _get_guest_xml network_info=[{"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '2a8018ec-3104-46ee-9d0b-90664f324407', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSPKulcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9e46d857-97e1-40a0-9232-57438a82f8c6', 'attached_at': '', 'detached_at': '', 'volume_id': 'eb9b9e63-b7e0-464b-b69f-aeac55c6d126', 'serial': 'eb9b9e63-b7e0-464b-b69f-aeac55c6d126'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-840a91c9-97dc-4326-9a91-ddea4d8fb6f0 req-6fc9a24d-1707-4c48-9865-1714a801e3ac service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Received event network-changed-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-840a91c9-97dc-4326-9a91-ddea4d8fb6f0 req-6fc9a24d-1707-4c48-9865-1714a801e3ac service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Refreshing instance network info cache due to event network-changed-ff5ab62a-73fd-4dcc-90dd-6e5923446b97. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-840a91c9-97dc-4326-9a91-ddea4d8fb6f0 req-6fc9a24d-1707-4c48-9865-1714a801e3ac service nova] Acquiring lock "refresh_cache-b4286998-93f6-439c-9c4e-b710d121420b" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-840a91c9-97dc-4326-9a91-ddea4d8fb6f0 req-6fc9a24d-1707-4c48-9865-1714a801e3ac service nova] Acquired lock "refresh_cache-b4286998-93f6-439c-9c4e-b710d121420b" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.network.neutron [req-840a91c9-97dc-4326-9a91-ddea4d8fb6f0 req-6fc9a24d-1707-4c48-9865-1714a801e3ac service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Refreshing network info cache for port ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:07:39 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:07:39 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSPKulcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:07:39 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:07:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:07:39 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:07:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:07:39 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56a41a4-f0ac-48a6-907f-3980a61a82bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:07:39 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c39c74-6376-4581-b07e-32856ada9735]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126] added
Oct 26 16:07:39 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a924d522-db8d-41f8-a3c1-9cf71c171928]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf2cdbe-b0da-41a2-8900-6cf2e59b5904]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HSPKulcT {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HSPKulcT" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7181cdd4-a2fa-495b-8a49-9f1b0625106f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HSPKulcT'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5092c37-21d6-44fa-94d5-3d496156a6be]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3269bc-298d-42e3-b452-f28dfaae2d63]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:07:39 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:07:39 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:07:39 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:07:39 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:07:39 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:07:39 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:07:39 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:07:39 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:07:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.network.neutron [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Successfully updated port: 948b856f-3b22-4614-96ca-7349cf1b9343 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd2432f-a7ed-407e-939c-bb8ab4a04161]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260]
Oct 26 16:07:40 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260] successful.
Oct 26 16:07:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "refresh_cache-511f84be-7779-4856-8611-9171c1b59d58" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquired lock "refresh_cache-511f84be-7779-4856-8611-9171c1b59d58" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.network.neutron [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a54d96-5de2-4e43-ac39-ff2d85318e23]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-e53fa5da-18f3-4522-a5df-60c1d8f33ab2 req-58ca368a-6812-4ebd-8273-1e118d11f230 service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Received event network-changed-948b856f-3b22-4614-96ca-7349cf1b9343 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-e53fa5da-18f3-4522-a5df-60c1d8f33ab2 req-58ca368a-6812-4ebd-8273-1e118d11f230 service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Refreshing instance network info cache due to event network-changed-948b856f-3b22-4614-96ca-7349cf1b9343. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e53fa5da-18f3-4522-a5df-60c1d8f33ab2 req-58ca368a-6812-4ebd-8273-1e118d11f230 service nova] Acquiring lock "refresh_cache-511f84be-7779-4856-8611-9171c1b59d58" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d319012-6264-4d51-805b-657c47744fe4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:07:40 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:07:40 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:07:40 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:07:40 user nova-compute[74646]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:07:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:07:40 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:07:40 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:07:40 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:07:40 user nova-compute[74646]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:07:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.network.neutron [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.037s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[762a6711-7e6b-4802-87ef-2b51417994b9]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSPKulcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.network.neutron [req-840a91c9-97dc-4326-9a91-ddea4d8fb6f0 req-6fc9a24d-1707-4c48-9865-1714a801e3ac service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Updated VIF entry in instance network info cache for port ff5ab62a-73fd-4dcc-90dd-6e5923446b97. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.network.neutron [req-840a91c9-97dc-4326-9a91-ddea4d8fb6f0 req-6fc9a24d-1707-4c48-9865-1714a801e3ac service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Updating instance_info_cache with network_info: [{"id": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "address": "fa:16:3e:5c:cb:d8", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5ab62a-73", "ovs_interfaceid": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-840a91c9-97dc-4326-9a91-ddea4d8fb6f0 req-6fc9a24d-1707-4c48-9865-1714a801e3ac service nova] Releasing lock "refresh_cache-b4286998-93f6-439c-9c4e-b710d121420b" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.network.neutron [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Updating instance_info_cache with network_info: [{"id": "948b856f-3b22-4614-96ca-7349cf1b9343", "address": "fa:16:3e:db:bd:9d", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b856f-3b", "ovs_interfaceid": "948b856f-3b22-4614-96ca-7349cf1b9343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Releasing lock "refresh_cache-511f84be-7779-4856-8611-9171c1b59d58" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Instance network_info: |[{"id": "948b856f-3b22-4614-96ca-7349cf1b9343", "address": "fa:16:3e:db:bd:9d", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b856f-3b", "ovs_interfaceid": "948b856f-3b22-4614-96ca-7349cf1b9343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e53fa5da-18f3-4522-a5df-60c1d8f33ab2 req-58ca368a-6812-4ebd-8273-1e118d11f230 service nova] Acquired lock "refresh_cache-511f84be-7779-4856-8611-9171c1b59d58" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.network.neutron [req-e53fa5da-18f3-4522-a5df-60c1d8f33ab2 req-58ca368a-6812-4ebd-8273-1e118d11f230 service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Refreshing network info cache for port 948b856f-3b22-4614-96ca-7349cf1b9343 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Start _get_guest_xml network_info=[{"id": "948b856f-3b22-4614-96ca-7349cf1b9343", "address": "fa:16:3e:db:bd:9d", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b856f-3b", "ovs_interfaceid": "948b856f-3b22-4614-96ca-7349cf1b9343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:07:40 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:07:40 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2124447205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2124447205',id=32,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90e848952345455183c15fee816b6f12',ramdisk_id='',reservation_id='r-y1v6qy1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-580785668',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:07:36Z,user_data=None,user_id='abd7a869c235467ca4da99867c6bc0d4',uuid=511f84be-7779-4856-8611-9171c1b59d58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "948b856f-3b22-4614-96ca-7349cf1b9343", "address": "fa:16:3e:db:bd:9d", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b856f-3b", "ovs_interfaceid": "948b856f-3b22-4614-96ca-7349cf1b9343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converting VIF {"id": "948b856f-3b22-4614-96ca-7349cf1b9343", "address": "fa:16:3e:db:bd:9d", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b856f-3b", "ovs_interfaceid": "948b856f-3b22-4614-96ca-7349cf1b9343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:bd:9d,bridge_name='br-int',has_traffic_filtering=True,id=948b856f-3b22-4614-96ca-7349cf1b9343,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948b856f-3b') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.objects.instance [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'pci_devices' on Instance uuid 511f84be-7779-4856-8611-9171c1b59d58 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:07:40 user nova-compute[74646]:   <uuid>511f84be-7779-4856-8611-9171c1b59d58</uuid>
Oct 26 16:07:40 user nova-compute[74646]:   <name>instance-00000020</name>
Oct 26 16:07:40 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:07:40 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:07:40 user nova-compute[74646]:   <metadata>
Oct 26 16:07:40 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:07:40 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:07:40 user nova-compute[74646]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2124447205</nova:name>
Oct 26 16:07:40 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:07:40</nova:creationTime>
Oct 26 16:07:40 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:07:40 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:07:40 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:07:40 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:07:40 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:07:40 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:07:40 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:07:40 user nova-compute[74646]:       <nova:owner>
Oct 26 16:07:40 user nova-compute[74646]:         <nova:user uuid="abd7a869c235467ca4da99867c6bc0d4">tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member</nova:user>
Oct 26 16:07:40 user nova-compute[74646]:         <nova:project uuid="90e848952345455183c15fee816b6f12">tempest-ServerBootFromVolumeStableRescueTest-580785668</nova:project>
Oct 26 16:07:40 user nova-compute[74646]:       </nova:owner>
Oct 26 16:07:40 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:07:40 user nova-compute[74646]:       <nova:ports>
Oct 26 16:07:40 user nova-compute[74646]:         <nova:port uuid="948b856f-3b22-4614-96ca-7349cf1b9343">
Oct 26 16:07:40 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 16:07:40 user nova-compute[74646]:         </nova:port>
Oct 26 16:07:40 user nova-compute[74646]:       </nova:ports>
Oct 26 16:07:40 user nova-compute[74646]:     </nova:instance>
Oct 26 16:07:40 user nova-compute[74646]:   </metadata>
Oct 26 16:07:40 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:07:40 user nova-compute[74646]:     <system>
Oct 26 16:07:40 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:07:40 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:07:40 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:07:40 user nova-compute[74646]:       <entry name="serial">511f84be-7779-4856-8611-9171c1b59d58</entry>
Oct 26 16:07:40 user nova-compute[74646]:       <entry name="uuid">511f84be-7779-4856-8611-9171c1b59d58</entry>
Oct 26 16:07:40 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:07:40 user nova-compute[74646]:     </system>
Oct 26 16:07:40 user nova-compute[74646]:   </sysinfo>
Oct 26 16:07:40 user nova-compute[74646]:   <os>
Oct 26 16:07:40 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:07:40 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:07:40 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:07:40 user nova-compute[74646]:   </os>
Oct 26 16:07:40 user nova-compute[74646]:   <features>
Oct 26 16:07:40 user nova-compute[74646]:     <acpi/>
Oct 26 16:07:40 user nova-compute[74646]:     <apic/>
Oct 26 16:07:40 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:07:40 user nova-compute[74646]:   </features>
Oct 26 16:07:40 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:07:40 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:07:40 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:07:40 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:07:40 user nova-compute[74646]:   </clock>
Oct 26 16:07:40 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:07:40 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:07:40 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:07:40 user nova-compute[74646]:   </cpu>
Oct 26 16:07:40 user nova-compute[74646]:   <devices>
Oct 26 16:07:40 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:07:40 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:07:40 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk"/>
Oct 26 16:07:40 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:07:40 user nova-compute[74646]:     </disk>
Oct 26 16:07:40 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:07:40 user nova-compute[74646]:       <mac address="fa:16:3e:db:bd:9d"/>
Oct 26 16:07:40 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:07:40 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:07:40 user nova-compute[74646]:       <target dev="tap948b856f-3b"/>
Oct 26 16:07:40 user nova-compute[74646]:     </interface>
Oct 26 16:07:40 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:07:40 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/console.log" append="off"/>
Oct 26 16:07:40 user nova-compute[74646]:     </serial>
Oct 26 16:07:40 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:07:40 user nova-compute[74646]:     <video>
Oct 26 16:07:40 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:07:40 user nova-compute[74646]:     </video>
Oct 26 16:07:40 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:07:40 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:07:40 user nova-compute[74646]:     </rng>
Oct 26 16:07:40 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:07:40 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:07:40 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:07:40 user nova-compute[74646]:     </memballoon>
Oct 26 16:07:40 user nova-compute[74646]:   </devices>
Oct 26 16:07:40 user nova-compute[74646]: </domain>
Oct 26 16:07:40 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2124447205',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2124447205',id=32,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90e848952345455183c15fee816b6f12',ramdisk_id='',reservation_id='r-y1v6qy1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-580785668',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:07:36Z,user_data=None,user_id='abd7a869c235467ca4da99867c6bc0d4',uuid=511f84be-7779-4856-8611-9171c1b59d58,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "948b856f-3b22-4614-96ca-7349cf1b9343", "address": "fa:16:3e:db:bd:9d", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b856f-3b", "ovs_interfaceid": "948b856f-3b22-4614-96ca-7349cf1b9343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converting VIF {"id": "948b856f-3b22-4614-96ca-7349cf1b9343", "address": "fa:16:3e:db:bd:9d", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b856f-3b", "ovs_interfaceid": "948b856f-3b22-4614-96ca-7349cf1b9343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:db:bd:9d,bridge_name='br-int',has_traffic_filtering=True,id=948b856f-3b22-4614-96ca-7349cf1b9343,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948b856f-3b') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG os_vif [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:bd:9d,bridge_name='br-int',has_traffic_filtering=True,id=948b856f-3b22-4614-96ca-7349cf1b9343,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948b856f-3b') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f2769716-3ac0-5a86-a407-4ac8c4e8840c', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap948b856f-3b, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap948b856f-3b, col_values=(('qos', UUID('114bb32f-b59b-44b4-8d13-dfed247b95ad')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap948b856f-3b, col_values=(('external_ids', {'iface-id': '948b856f-3b22-4614-96ca-7349cf1b9343', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:db:bd:9d', 'vm-uuid': '511f84be-7779-4856-8611-9171c1b59d58'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:40 user nova-compute[74646]: INFO os_vif [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:db:bd:9d,bridge_name='br-int',has_traffic_filtering=True,id=948b856f-3b22-4614-96ca-7349cf1b9343,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948b856f-3b')
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:07:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] No VIF found with MAC fa:16:3e:db:bd:9d, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] <== connect_volume: return (1455ms) {'type': 'block', 'scsi_wwn': '23630666438333432', 'path': '/dev/sdf'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630666438333432', 'path': '/dev/sdf'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG nova.network.neutron [req-e53fa5da-18f3-4522-a5df-60c1d8f33ab2 req-58ca368a-6812-4ebd-8273-1e118d11f230 service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Updated VIF entry in instance network info cache for port 948b856f-3b22-4614-96ca-7349cf1b9343. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG nova.network.neutron [req-e53fa5da-18f3-4522-a5df-60c1d8f33ab2 req-58ca368a-6812-4ebd-8273-1e118d11f230 service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Updating instance_info_cache with network_info: [{"id": "948b856f-3b22-4614-96ca-7349cf1b9343", "address": "fa:16:3e:db:bd:9d", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b856f-3b", "ovs_interfaceid": "948b856f-3b22-4614-96ca-7349cf1b9343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-700043270',display_name='tempest-ServerActionsTestOtherA-server-700043270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-700043270',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFpQMuDQ9yV5cYwbhkTyRLOjZZ0Tl/sjjENeyylssja83c6EpW+JftZQ9mXXtyfrIqGGnek7tn477+zNOt3iNR5IPo2YdOD8TzgfFC3ul9nIufuOchmOZ60R0hjnHQdyg==',key_name='tempest-keypair-1269718539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-an258biy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=9e46d857-97e1-40a0-9232-57438a82f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:e2,bridge_name='br-int',has_traffic_filtering=True,id=898eb4a5-708b-4414-bc27-1413e1a1d978,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898eb4a5-70') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG nova.objects.instance [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lazy-loading 'pci_devices' on Instance uuid 9e46d857-97e1-40a0-9232-57438a82f8c6 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e53fa5da-18f3-4522-a5df-60c1d8f33ab2 req-58ca368a-6812-4ebd-8273-1e118d11f230 service nova] Releasing lock "refresh_cache-511f84be-7779-4856-8611-9171c1b59d58" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:07:41 user nova-compute[74646]:   <uuid>9e46d857-97e1-40a0-9232-57438a82f8c6</uuid>
Oct 26 16:07:41 user nova-compute[74646]:   <name>instance-0000001f</name>
Oct 26 16:07:41 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:07:41 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:07:41 user nova-compute[74646]:   <metadata>
Oct 26 16:07:41 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:07:41 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:07:41 user nova-compute[74646]:       <nova:name>tempest-ServerActionsTestOtherA-server-700043270</nova:name>
Oct 26 16:07:41 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:07:39</nova:creationTime>
Oct 26 16:07:41 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:07:41 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:07:41 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:07:41 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:07:41 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:07:41 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:07:41 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:07:41 user nova-compute[74646]:       <nova:owner>
Oct 26 16:07:41 user nova-compute[74646]:         <nova:user uuid="9311cee7c04e45ddbae6f16ba43eed2e">tempest-ServerActionsTestOtherA-333958340-project-member</nova:user>
Oct 26 16:07:41 user nova-compute[74646]:         <nova:project uuid="6c8788e95cc244f98b0ff8d593d1e067">tempest-ServerActionsTestOtherA-333958340</nova:project>
Oct 26 16:07:41 user nova-compute[74646]:       </nova:owner>
Oct 26 16:07:41 user nova-compute[74646]:       <nova:ports>
Oct 26 16:07:41 user nova-compute[74646]:         <nova:port uuid="898eb4a5-708b-4414-bc27-1413e1a1d978">
Oct 26 16:07:41 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 16:07:41 user nova-compute[74646]:         </nova:port>
Oct 26 16:07:41 user nova-compute[74646]:       </nova:ports>
Oct 26 16:07:41 user nova-compute[74646]:     </nova:instance>
Oct 26 16:07:41 user nova-compute[74646]:   </metadata>
Oct 26 16:07:41 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:07:41 user nova-compute[74646]:     <system>
Oct 26 16:07:41 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:07:41 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:07:41 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:07:41 user nova-compute[74646]:       <entry name="serial">9e46d857-97e1-40a0-9232-57438a82f8c6</entry>
Oct 26 16:07:41 user nova-compute[74646]:       <entry name="uuid">9e46d857-97e1-40a0-9232-57438a82f8c6</entry>
Oct 26 16:07:41 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:07:41 user nova-compute[74646]:     </system>
Oct 26 16:07:41 user nova-compute[74646]:   </sysinfo>
Oct 26 16:07:41 user nova-compute[74646]:   <os>
Oct 26 16:07:41 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:07:41 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:07:41 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:07:41 user nova-compute[74646]:   </os>
Oct 26 16:07:41 user nova-compute[74646]:   <features>
Oct 26 16:07:41 user nova-compute[74646]:     <acpi/>
Oct 26 16:07:41 user nova-compute[74646]:     <apic/>
Oct 26 16:07:41 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:07:41 user nova-compute[74646]:   </features>
Oct 26 16:07:41 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:07:41 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:07:41 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:07:41 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:07:41 user nova-compute[74646]:   </clock>
Oct 26 16:07:41 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:07:41 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:07:41 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:07:41 user nova-compute[74646]:   </cpu>
Oct 26 16:07:41 user nova-compute[74646]:   <devices>
Oct 26 16:07:41 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:07:41 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:07:41 user nova-compute[74646]:       <source dev="/dev/sdf"/>
Oct 26 16:07:41 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:07:41 user nova-compute[74646]:       <serial>eb9b9e63-b7e0-464b-b69f-aeac55c6d126</serial>
Oct 26 16:07:41 user nova-compute[74646]:     </disk>
Oct 26 16:07:41 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:07:41 user nova-compute[74646]:       <mac address="fa:16:3e:c1:c7:e2"/>
Oct 26 16:07:41 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:07:41 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:07:41 user nova-compute[74646]:       <target dev="tap898eb4a5-70"/>
Oct 26 16:07:41 user nova-compute[74646]:     </interface>
Oct 26 16:07:41 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:07:41 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/9e46d857-97e1-40a0-9232-57438a82f8c6/console.log" append="off"/>
Oct 26 16:07:41 user nova-compute[74646]:     </serial>
Oct 26 16:07:41 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:07:41 user nova-compute[74646]:     <video>
Oct 26 16:07:41 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:07:41 user nova-compute[74646]:     </video>
Oct 26 16:07:41 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:07:41 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:07:41 user nova-compute[74646]:     </rng>
Oct 26 16:07:41 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:07:41 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:07:41 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:07:41 user nova-compute[74646]:     </memballoon>
Oct 26 16:07:41 user nova-compute[74646]:   </devices>
Oct 26 16:07:41 user nova-compute[74646]: </domain>
Oct 26 16:07:41 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-700043270',display_name='tempest-ServerActionsTestOtherA-server-700043270',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-700043270',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFpQMuDQ9yV5cYwbhkTyRLOjZZ0Tl/sjjENeyylssja83c6EpW+JftZQ9mXXtyfrIqGGnek7tn477+zNOt3iNR5IPo2YdOD8TzgfFC3ul9nIufuOchmOZ60R0hjnHQdyg==',key_name='tempest-keypair-1269718539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-an258biy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:07:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=9e46d857-97e1-40a0-9232-57438a82f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:e2,bridge_name='br-int',has_traffic_filtering=True,id=898eb4a5-708b-4414-bc27-1413e1a1d978,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898eb4a5-70') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG os_vif [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:e2,bridge_name='br-int',has_traffic_filtering=True,id=898eb4a5-708b-4414-bc27-1413e1a1d978,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898eb4a5-70') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5eb73e16-20dc-51a0-bc73-5614296a99a7', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap898eb4a5-70, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap898eb4a5-70, col_values=(('qos', UUID('ad53df8c-565a-4329-a1a8-7fa392183b9a')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap898eb4a5-70, col_values=(('external_ids', {'iface-id': '898eb4a5-708b-4414-bc27-1413e1a1d978', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:c7:e2', 'vm-uuid': '9e46d857-97e1-40a0-9232-57438a82f8c6'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:41 user nova-compute[74646]: INFO os_vif [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:e2,bridge_name='br-int',has_traffic_filtering=True,id=898eb4a5-708b-4414-bc27-1413e1a1d978,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898eb4a5-70')
Oct 26 16:07:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:07:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] No VIF found with MAC fa:16:3e:c1:c7:e2, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:07:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "0c285c4b-4895-424b-867d-af1fd8e6d151" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:42 user nova-compute[74646]: DEBUG nova.compute.manager [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:07:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:42 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:07:42 user nova-compute[74646]: INFO nova.compute.claims [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Claim successful on node user
Oct 26 16:07:42 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:07:42 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.548s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG nova.compute.manager [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG nova.compute.manager [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:07:43 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:07:43 user nova-compute[74646]: DEBUG nova.compute.manager [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG nova.policy [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c5e462c338d54529b83b12a7980228ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16026a9a67e34ea484655daa6a1a846e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG nova.compute.manager [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:07:43 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Creating image(s)
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "/opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "/opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "/opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.231s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG nova.compute.manager [req-7d581f27-dc5c-41f5-9b1b-574beb5e5785 req-37d61643-ebf7-4803-8448-6f97e0ccab1d service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Received event network-vif-plugged-948b856f-3b22-4614-96ca-7349cf1b9343 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7d581f27-dc5c-41f5-9b1b-574beb5e5785 req-37d61643-ebf7-4803-8448-6f97e0ccab1d service nova] Acquiring lock "511f84be-7779-4856-8611-9171c1b59d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7d581f27-dc5c-41f5-9b1b-574beb5e5785 req-37d61643-ebf7-4803-8448-6f97e0ccab1d service nova] Lock "511f84be-7779-4856-8611-9171c1b59d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7d581f27-dc5c-41f5-9b1b-574beb5e5785 req-37d61643-ebf7-4803-8448-6f97e0ccab1d service nova] Lock "511f84be-7779-4856-8611-9171c1b59d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG nova.compute.manager [req-7d581f27-dc5c-41f5-9b1b-574beb5e5785 req-37d61643-ebf7-4803-8448-6f97e0ccab1d service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] No waiting events found dispatching network-vif-plugged-948b856f-3b22-4614-96ca-7349cf1b9343 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:07:43 user nova-compute[74646]: WARNING nova.compute.manager [req-7d581f27-dc5c-41f5-9b1b-574beb5e5785 req-37d61643-ebf7-4803-8448-6f97e0ccab1d service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Received unexpected event network-vif-plugged-948b856f-3b22-4614-96ca-7349cf1b9343 for instance with vm_state building and task_state spawning.
Oct 26 16:07:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.261s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk 1073741824" returned: 0 in 0.060s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG nova.compute.manager [req-2166abdb-6ce3-4838-8bfd-d98bd7233a34 req-1c272c14-7968-4e0f-8db8-254596113f15 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received event network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2166abdb-6ce3-4838-8bfd-d98bd7233a34 req-1c272c14-7968-4e0f-8db8-254596113f15 service nova] Acquiring lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2166abdb-6ce3-4838-8bfd-d98bd7233a34 req-1c272c14-7968-4e0f-8db8-254596113f15 service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2166abdb-6ce3-4838-8bfd-d98bd7233a34 req-1c272c14-7968-4e0f-8db8-254596113f15 service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG nova.compute.manager [req-2166abdb-6ce3-4838-8bfd-d98bd7233a34 req-1c272c14-7968-4e0f-8db8-254596113f15 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] No waiting events found dispatching network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:07:44 user nova-compute[74646]: WARNING nova.compute.manager [req-2166abdb-6ce3-4838-8bfd-d98bd7233a34 req-1c272c14-7968-4e0f-8db8-254596113f15 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received unexpected event network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 for instance with vm_state building and task_state spawning.
Oct 26 16:07:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.258s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Cannot resize image /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Ensure instance console log exists: /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:44 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Successfully created port: 1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Successfully updated port: 1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "refresh_cache-0c285c4b-4895-424b-867d-af1fd8e6d151" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquired lock "refresh_cache-0c285c4b-4895-424b-867d-af1fd8e6d151" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-80ce79f4-964c-4621-9ca5-8511d691b8be req-cfae5424-94cc-4084-8aa4-2ced845ac6a9 service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Received event network-vif-plugged-948b856f-3b22-4614-96ca-7349cf1b9343 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-80ce79f4-964c-4621-9ca5-8511d691b8be req-cfae5424-94cc-4084-8aa4-2ced845ac6a9 service nova] Acquiring lock "511f84be-7779-4856-8611-9171c1b59d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-80ce79f4-964c-4621-9ca5-8511d691b8be req-cfae5424-94cc-4084-8aa4-2ced845ac6a9 service nova] Lock "511f84be-7779-4856-8611-9171c1b59d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-80ce79f4-964c-4621-9ca5-8511d691b8be req-cfae5424-94cc-4084-8aa4-2ced845ac6a9 service nova] Lock "511f84be-7779-4856-8611-9171c1b59d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-80ce79f4-964c-4621-9ca5-8511d691b8be req-cfae5424-94cc-4084-8aa4-2ced845ac6a9 service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] No waiting events found dispatching network-vif-plugged-948b856f-3b22-4614-96ca-7349cf1b9343 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:07:45 user nova-compute[74646]: WARNING nova.compute.manager [req-80ce79f4-964c-4621-9ca5-8511d691b8be req-cfae5424-94cc-4084-8aa4-2ced845ac6a9 service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Received unexpected event network-vif-plugged-948b856f-3b22-4614-96ca-7349cf1b9343 for instance with vm_state building and task_state spawning.
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Updating instance_info_cache with network_info: [{"id": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "address": "fa:16:3e:9a:e9:aa", "network": {"id": "5f672f1e-93ae-4952-a144-4b4e974c1ab8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1833332180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16026a9a67e34ea484655daa6a1a846e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e37abb8-60", "ovs_interfaceid": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Releasing lock "refresh_cache-0c285c4b-4895-424b-867d-af1fd8e6d151" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.compute.manager [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Instance network_info: |[{"id": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "address": "fa:16:3e:9a:e9:aa", "network": {"id": "5f672f1e-93ae-4952-a144-4b4e974c1ab8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1833332180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16026a9a67e34ea484655daa6a1a846e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e37abb8-60", "ovs_interfaceid": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Start _get_guest_xml network_info=[{"id": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "address": "fa:16:3e:9a:e9:aa", "network": {"id": "5f672f1e-93ae-4952-a144-4b4e974c1ab8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1833332180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16026a9a67e34ea484655daa6a1a846e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e37abb8-60", "ovs_interfaceid": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:07:45 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:07:45 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1341164739',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1341164739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1341164',id=33,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSnM7JUOGq+/2waZUcXiokKr3uTVGBMJa9BRyC8NWG7XTkHZWv58JDAyYXv/WICiZ5qVQQPPDLngxzSVMnkgMUOppBAa6iMW4ifg3nfnlada2UVJY0KZ0MRjyC0G55h7A==',key_name='tempest-keypair-1723281814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16026a9a67e34ea484655daa6a1a846e',ramdisk_id='',reservation_id='r-l4d889wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2116619154',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e462c338d54529b83b12a7980228ff',uuid=0c285c4b-4895-424b-867d-af1fd8e6d151,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "address": "fa:16:3e:9a:e9:aa", "network": {"id": "5f672f1e-93ae-4952-a144-4b4e974c1ab8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1833332180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16026a9a67e34ea484655daa6a1a846e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e37abb8-60", "ovs_interfaceid": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Converting VIF {"id": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "address": "fa:16:3e:9a:e9:aa", "network": {"id": "5f672f1e-93ae-4952-a144-4b4e974c1ab8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1833332180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16026a9a67e34ea484655daa6a1a846e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e37abb8-60", "ovs_interfaceid": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e9:aa,bridge_name='br-int',has_traffic_filtering=True,id=1e37abb8-6088-435a-bf9c-9fd52dc2c4ab,network=Network(5f672f1e-93ae-4952-a144-4b4e974c1ab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e37abb8-60') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.objects.instance [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lazy-loading 'pci_devices' on Instance uuid 0c285c4b-4895-424b-867d-af1fd8e6d151 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:07:45 user nova-compute[74646]:   <uuid>0c285c4b-4895-424b-867d-af1fd8e6d151</uuid>
Oct 26 16:07:45 user nova-compute[74646]:   <name>instance-00000021</name>
Oct 26 16:07:45 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:07:45 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:07:45 user nova-compute[74646]:   <metadata>
Oct 26 16:07:45 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:07:45 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:07:45 user nova-compute[74646]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1341164739</nova:name>
Oct 26 16:07:45 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:07:45</nova:creationTime>
Oct 26 16:07:45 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:07:45 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:07:45 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:07:45 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:07:45 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:07:45 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:07:45 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:07:45 user nova-compute[74646]:       <nova:owner>
Oct 26 16:07:45 user nova-compute[74646]:         <nova:user uuid="c5e462c338d54529b83b12a7980228ff">tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member</nova:user>
Oct 26 16:07:45 user nova-compute[74646]:         <nova:project uuid="16026a9a67e34ea484655daa6a1a846e">tempest-TestServerVolumeAttachScenarioOldVersion-2116619154</nova:project>
Oct 26 16:07:45 user nova-compute[74646]:       </nova:owner>
Oct 26 16:07:45 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:07:45 user nova-compute[74646]:       <nova:ports>
Oct 26 16:07:45 user nova-compute[74646]:         <nova:port uuid="1e37abb8-6088-435a-bf9c-9fd52dc2c4ab">
Oct 26 16:07:45 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 16:07:45 user nova-compute[74646]:         </nova:port>
Oct 26 16:07:45 user nova-compute[74646]:       </nova:ports>
Oct 26 16:07:45 user nova-compute[74646]:     </nova:instance>
Oct 26 16:07:45 user nova-compute[74646]:   </metadata>
Oct 26 16:07:45 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:07:45 user nova-compute[74646]:     <system>
Oct 26 16:07:45 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:07:45 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:07:45 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:07:45 user nova-compute[74646]:       <entry name="serial">0c285c4b-4895-424b-867d-af1fd8e6d151</entry>
Oct 26 16:07:45 user nova-compute[74646]:       <entry name="uuid">0c285c4b-4895-424b-867d-af1fd8e6d151</entry>
Oct 26 16:07:45 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:07:45 user nova-compute[74646]:     </system>
Oct 26 16:07:45 user nova-compute[74646]:   </sysinfo>
Oct 26 16:07:45 user nova-compute[74646]:   <os>
Oct 26 16:07:45 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:07:45 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:07:45 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:07:45 user nova-compute[74646]:   </os>
Oct 26 16:07:45 user nova-compute[74646]:   <features>
Oct 26 16:07:45 user nova-compute[74646]:     <acpi/>
Oct 26 16:07:45 user nova-compute[74646]:     <apic/>
Oct 26 16:07:45 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:07:45 user nova-compute[74646]:   </features>
Oct 26 16:07:45 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:07:45 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:07:45 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:07:45 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:07:45 user nova-compute[74646]:   </clock>
Oct 26 16:07:45 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:07:45 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:07:45 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:07:45 user nova-compute[74646]:   </cpu>
Oct 26 16:07:45 user nova-compute[74646]:   <devices>
Oct 26 16:07:45 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:07:45 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:07:45 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk"/>
Oct 26 16:07:45 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:07:45 user nova-compute[74646]:     </disk>
Oct 26 16:07:45 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:07:45 user nova-compute[74646]:       <mac address="fa:16:3e:9a:e9:aa"/>
Oct 26 16:07:45 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:07:45 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:07:45 user nova-compute[74646]:       <target dev="tap1e37abb8-60"/>
Oct 26 16:07:45 user nova-compute[74646]:     </interface>
Oct 26 16:07:45 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:07:45 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/console.log" append="off"/>
Oct 26 16:07:45 user nova-compute[74646]:     </serial>
Oct 26 16:07:45 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:07:45 user nova-compute[74646]:     <video>
Oct 26 16:07:45 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:07:45 user nova-compute[74646]:     </video>
Oct 26 16:07:45 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:07:45 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:07:45 user nova-compute[74646]:     </rng>
Oct 26 16:07:45 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:07:45 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:07:45 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:07:45 user nova-compute[74646]:     </memballoon>
Oct 26 16:07:45 user nova-compute[74646]:   </devices>
Oct 26 16:07:45 user nova-compute[74646]: </domain>
Oct 26 16:07:45 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1341164739',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1341164739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1341164',id=33,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSnM7JUOGq+/2waZUcXiokKr3uTVGBMJa9BRyC8NWG7XTkHZWv58JDAyYXv/WICiZ5qVQQPPDLngxzSVMnkgMUOppBAa6iMW4ifg3nfnlada2UVJY0KZ0MRjyC0G55h7A==',key_name='tempest-keypair-1723281814',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='16026a9a67e34ea484655daa6a1a846e',ramdisk_id='',reservation_id='r-l4d889wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2116619154',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e462c338d54529b83b12a7980228ff',uuid=0c285c4b-4895-424b-867d-af1fd8e6d151,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "address": "fa:16:3e:9a:e9:aa", "network": {"id": "5f672f1e-93ae-4952-a144-4b4e974c1ab8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1833332180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16026a9a67e34ea484655daa6a1a846e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e37abb8-60", "ovs_interfaceid": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Converting VIF {"id": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "address": "fa:16:3e:9a:e9:aa", "network": {"id": "5f672f1e-93ae-4952-a144-4b4e974c1ab8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1833332180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16026a9a67e34ea484655daa6a1a846e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e37abb8-60", "ovs_interfaceid": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e9:aa,bridge_name='br-int',has_traffic_filtering=True,id=1e37abb8-6088-435a-bf9c-9fd52dc2c4ab,network=Network(5f672f1e-93ae-4952-a144-4b4e974c1ab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e37abb8-60') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG os_vif [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e9:aa,bridge_name='br-int',has_traffic_filtering=True,id=1e37abb8-6088-435a-bf9c-9fd52dc2c4ab,network=Network(5f672f1e-93ae-4952-a144-4b4e974c1ab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e37abb8-60') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b29d9182-6751-58d2-a16a-3fb2ad83f31e', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1e37abb8-60, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1e37abb8-60, col_values=(('qos', UUID('b2ad373d-7855-4d80-8c27-76ddd382f8ee')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1e37abb8-60, col_values=(('external_ids', {'iface-id': '1e37abb8-6088-435a-bf9c-9fd52dc2c4ab', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:e9:aa', 'vm-uuid': '0c285c4b-4895-424b-867d-af1fd8e6d151'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:46 user nova-compute[74646]: INFO os_vif [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:e9:aa,bridge_name='br-int',has_traffic_filtering=True,id=1e37abb8-6088-435a-bf9c-9fd52dc2c4ab,network=Network(5f672f1e-93ae-4952-a144-4b4e974c1ab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e37abb8-60')
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] No VIF found with MAC fa:16:3e:9a:e9:aa, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.compute.manager [req-f0d98c23-d7a3-4d52-873f-db25ca8a09a7 req-9aebc499-3b24-4f94-ba42-8cb982e38d8f service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received event network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f0d98c23-d7a3-4d52-873f-db25ca8a09a7 req-9aebc499-3b24-4f94-ba42-8cb982e38d8f service nova] Acquiring lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f0d98c23-d7a3-4d52-873f-db25ca8a09a7 req-9aebc499-3b24-4f94-ba42-8cb982e38d8f service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f0d98c23-d7a3-4d52-873f-db25ca8a09a7 req-9aebc499-3b24-4f94-ba42-8cb982e38d8f service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.compute.manager [req-f0d98c23-d7a3-4d52-873f-db25ca8a09a7 req-9aebc499-3b24-4f94-ba42-8cb982e38d8f service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] No waiting events found dispatching network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:07:46 user nova-compute[74646]: WARNING nova.compute.manager [req-f0d98c23-d7a3-4d52-873f-db25ca8a09a7 req-9aebc499-3b24-4f94-ba42-8cb982e38d8f service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received unexpected event network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 for instance with vm_state building and task_state spawning.
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.compute.manager [req-f0d98c23-d7a3-4d52-873f-db25ca8a09a7 req-9aebc499-3b24-4f94-ba42-8cb982e38d8f service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Received event network-changed-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.compute.manager [req-f0d98c23-d7a3-4d52-873f-db25ca8a09a7 req-9aebc499-3b24-4f94-ba42-8cb982e38d8f service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Refreshing instance network info cache due to event network-changed-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f0d98c23-d7a3-4d52-873f-db25ca8a09a7 req-9aebc499-3b24-4f94-ba42-8cb982e38d8f service nova] Acquiring lock "refresh_cache-0c285c4b-4895-424b-867d-af1fd8e6d151" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f0d98c23-d7a3-4d52-873f-db25ca8a09a7 req-9aebc499-3b24-4f94-ba42-8cb982e38d8f service nova] Acquired lock "refresh_cache-0c285c4b-4895-424b-867d-af1fd8e6d151" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.network.neutron [req-f0d98c23-d7a3-4d52-873f-db25ca8a09a7 req-9aebc499-3b24-4f94-ba42-8cb982e38d8f service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Refreshing network info cache for port 1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:07:46 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Instance spawned successfully.
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:07:46 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Instance spawned successfully.
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:46 user nova-compute[74646]: INFO nova.compute.manager [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Took 10.23 seconds to spawn the instance on the hypervisor.
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:07:46 user nova-compute[74646]: INFO nova.compute.manager [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Took 7.03 seconds to spawn the instance on the hypervisor.
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:07:46 user nova-compute[74646]: INFO nova.compute.manager [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Took 11.32 seconds to build instance.
Oct 26 16:07:46 user nova-compute[74646]: INFO nova.compute.manager [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Took 31.02 seconds to build instance.
Oct 26 16:07:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-21f2541f-598f-4d69-9f15-fce99a0c4d55 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "511f84be-7779-4856-8611-9171c1b59d58" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.447s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ac244de1-01a7-431e-8009-29972c72b576 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.126s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.network.neutron [req-f0d98c23-d7a3-4d52-873f-db25ca8a09a7 req-9aebc499-3b24-4f94-ba42-8cb982e38d8f service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Updated VIF entry in instance network info cache for port 1e37abb8-6088-435a-bf9c-9fd52dc2c4ab. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:07:46 user nova-compute[74646]: DEBUG nova.network.neutron [req-f0d98c23-d7a3-4d52-873f-db25ca8a09a7 req-9aebc499-3b24-4f94-ba42-8cb982e38d8f service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Updating instance_info_cache with network_info: [{"id": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "address": "fa:16:3e:9a:e9:aa", "network": {"id": "5f672f1e-93ae-4952-a144-4b4e974c1ab8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1833332180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16026a9a67e34ea484655daa6a1a846e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e37abb8-60", "ovs_interfaceid": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:07:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f0d98c23-d7a3-4d52-873f-db25ca8a09a7 req-9aebc499-3b24-4f94-ba42-8cb982e38d8f service nova] Releasing lock "refresh_cache-0c285c4b-4895-424b-867d-af1fd8e6d151" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:07:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-d11f8985-e807-4b28-8686-1abb80afcd72 req-5c386fae-4d57-45c0-bedc-2fc906584fea service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Received event network-vif-plugged-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:07:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d11f8985-e807-4b28-8686-1abb80afcd72 req-5c386fae-4d57-45c0-bedc-2fc906584fea service nova] Acquiring lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d11f8985-e807-4b28-8686-1abb80afcd72 req-5c386fae-4d57-45c0-bedc-2fc906584fea service nova] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d11f8985-e807-4b28-8686-1abb80afcd72 req-5c386fae-4d57-45c0-bedc-2fc906584fea service nova] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-d11f8985-e807-4b28-8686-1abb80afcd72 req-5c386fae-4d57-45c0-bedc-2fc906584fea service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] No waiting events found dispatching network-vif-plugged-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:07:48 user nova-compute[74646]: WARNING nova.compute.manager [req-d11f8985-e807-4b28-8686-1abb80afcd72 req-5c386fae-4d57-45c0-bedc-2fc906584fea service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Received unexpected event network-vif-plugged-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab for instance with vm_state building and task_state spawning.
Oct 26 16:07:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-fae2377a-30d9-48ee-8373-536e5e39bdd9 req-6e278794-25ea-4b4d-ba9d-248852797a5b service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Received event network-vif-plugged-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:07:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fae2377a-30d9-48ee-8373-536e5e39bdd9 req-6e278794-25ea-4b4d-ba9d-248852797a5b service nova] Acquiring lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fae2377a-30d9-48ee-8373-536e5e39bdd9 req-6e278794-25ea-4b4d-ba9d-248852797a5b service nova] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fae2377a-30d9-48ee-8373-536e5e39bdd9 req-6e278794-25ea-4b4d-ba9d-248852797a5b service nova] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-fae2377a-30d9-48ee-8373-536e5e39bdd9 req-6e278794-25ea-4b4d-ba9d-248852797a5b service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] No waiting events found dispatching network-vif-plugged-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:07:50 user nova-compute[74646]: WARNING nova.compute.manager [req-fae2377a-30d9-48ee-8373-536e5e39bdd9 req-6e278794-25ea-4b4d-ba9d-248852797a5b service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Received unexpected event network-vif-plugged-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab for instance with vm_state building and task_state spawning.
Oct 26 16:07:50 user nova-compute[74646]: DEBUG nova.compute.manager [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:07:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:07:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Instance spawned successfully.
Oct 26 16:07:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:07:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:07:50 user nova-compute[74646]: INFO nova.compute.manager [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Took 7.54 seconds to spawn the instance on the hypervisor.
Oct 26 16:07:50 user nova-compute[74646]: DEBUG nova.compute.manager [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:07:50 user nova-compute[74646]: INFO nova.compute.manager [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Took 8.57 seconds to build instance.
Oct 26 16:07:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8979b3f8-f248-43d0-a55e-acb0872d2006 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.689s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:07:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "92c76eb3-f5d6-4233-97d3-55f0a944f798" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "92c76eb3-f5d6-4233-97d3-55f0a944f798" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:56 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:07:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:07:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:07:57 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:07:57 user nova-compute[74646]: INFO nova.compute.claims [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Claim successful on node user
Oct 26 16:07:57 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:07:57 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:07:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:07:57 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:07:57 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:07:57 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:07:57 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:07:57 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:07:57 user nova-compute[74646]: INFO nova.virt.block_device [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Booting with volume snapshot a73d12e5-a9b5-4dca-8740-2328303395f2 at /dev/vda
Oct 26 16:07:58 user nova-compute[74646]: DEBUG nova.policy [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9419f9603ca647269ed1cf42e233507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a984c8da90ff476191cd5aa5787032c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:07:58 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Successfully created port: 2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:07:59 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Successfully updated port: 2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:07:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "refresh_cache-92c76eb3-f5d6-4233-97d3-55f0a944f798" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:07:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquired lock "refresh_cache-92c76eb3-f5d6-4233-97d3-55f0a944f798" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:07:59 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:07:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-2fe31cf4-e56b-4925-bbe5-07a85f58c538 req-07e82b2c-8b58-4eff-974f-6c93d17623f1 service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Received event network-changed-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:07:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-2fe31cf4-e56b-4925-bbe5-07a85f58c538 req-07e82b2c-8b58-4eff-974f-6c93d17623f1 service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Refreshing instance network info cache due to event network-changed-2aae00e0-f06a-495d-a4f8-90dadf9d67e8. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:07:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2fe31cf4-e56b-4925-bbe5-07a85f58c538 req-07e82b2c-8b58-4eff-974f-6c93d17623f1 service nova] Acquiring lock "refresh_cache-92c76eb3-f5d6-4233-97d3-55f0a944f798" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:07:59 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:08:00 user nova-compute[74646]: DEBUG nova.network.neutron [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Updating instance_info_cache with network_info: [{"id": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "address": "fa:16:3e:12:fd:2d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aae00e0-f0", "ovs_interfaceid": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:08:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Releasing lock "refresh_cache-92c76eb3-f5d6-4233-97d3-55f0a944f798" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:08:00 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Instance network_info: |[{"id": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "address": "fa:16:3e:12:fd:2d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aae00e0-f0", "ovs_interfaceid": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:08:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2fe31cf4-e56b-4925-bbe5-07a85f58c538 req-07e82b2c-8b58-4eff-974f-6c93d17623f1 service nova] Acquired lock "refresh_cache-92c76eb3-f5d6-4233-97d3-55f0a944f798" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:08:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-2fe31cf4-e56b-4925-bbe5-07a85f58c538 req-07e82b2c-8b58-4eff-974f-6c93d17623f1 service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Refreshing network info cache for port 2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:08:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-2fe31cf4-e56b-4925-bbe5-07a85f58c538 req-07e82b2c-8b58-4eff-974f-6c93d17623f1 service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Updated VIF entry in instance network info cache for port 2aae00e0-f06a-495d-a4f8-90dadf9d67e8. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:08:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-2fe31cf4-e56b-4925-bbe5-07a85f58c538 req-07e82b2c-8b58-4eff-974f-6c93d17623f1 service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Updating instance_info_cache with network_info: [{"id": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "address": "fa:16:3e:12:fd:2d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aae00e0-f0", "ovs_interfaceid": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:08:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2fe31cf4-e56b-4925-bbe5-07a85f58c538 req-07e82b2c-8b58-4eff-974f-6c93d17623f1 service nova] Releasing lock "refresh_cache-92c76eb3-f5d6-4233-97d3-55f0a944f798" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:08:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG os_brick.utils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb7d260-f32f-4c49-81db-ef8f76f86ec6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[043ef698-d4f8-47ff-9697-dbfbcd5db48d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[999e537f-0d67-46d3-9d16-5dec7fee9f9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da84ecc-817b-424e-b71b-4c11a39f2166]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:08:08 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:08:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e163922-6e32-41ff-a2e3-060d128b950a]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG os_brick.utils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:08:08 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Updating existing volume attachment record: 207db478-ad30-44e2-bd14-42a6669f8dc2 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:08:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:26 user nova-compute[74646]: INFO nova.compute.manager [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Terminating instance
Oct 26 16:08:26 user nova-compute[74646]: DEBUG nova.compute.manager [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-2465cf28-f99b-49f3-9a63-2ac394d414ed req-2d837e22-aa7f-4421-883b-4b2aa2d11b97 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Received event network-vif-unplugged-a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2465cf28-f99b-49f3-9a63-2ac394d414ed req-2d837e22-aa7f-4421-883b-4b2aa2d11b97 service nova] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2465cf28-f99b-49f3-9a63-2ac394d414ed req-2d837e22-aa7f-4421-883b-4b2aa2d11b97 service nova] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2465cf28-f99b-49f3-9a63-2ac394d414ed req-2d837e22-aa7f-4421-883b-4b2aa2d11b97 service nova] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-2465cf28-f99b-49f3-9a63-2ac394d414ed req-2d837e22-aa7f-4421-883b-4b2aa2d11b97 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] No waiting events found dispatching network-vif-unplugged-a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:08:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-2465cf28-f99b-49f3-9a63-2ac394d414ed req-2d837e22-aa7f-4421-883b-4b2aa2d11b97 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Received event network-vif-unplugged-a74a819f-2d80-4dca-bf03-eb6bf80868ba for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:08:27 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Instance destroyed successfully.
Oct 26 16:08:27 user nova-compute[74646]: DEBUG nova.objects.instance [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lazy-loading 'resources' on Instance uuid 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:08:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:57:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-129527195',display_name='tempest-SnapshotDataIntegrityTests-server-129527195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-129527195',id=18,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEeHOIHOktuyx2WIEcsYqkh8fe5sPyHUl9nE10Nl77UQW5w8sR3gMZ1hGHcGcH5g6TTKp6uXRXWITQ294MOmx7fURmc4lGmiS4sggonAu+FOqJY3SHctp0TkyKFEAV5cjA==',key_name='tempest-keypair-901959329',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:57:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='63fd26edea684a8d997c1b577ff8d859',ramdisk_id='',reservation_id='r-tune5b4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-204349635',owner_user_name='tempest-SnapshotDataIntegrityTests-204349635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:57:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='207cd8b6d7994d198a7068a196cc1455',uuid=89f3a200-afb7-4c79-a6a1-5a1b434aeaa0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "address": "fa:16:3e:cc:b0:d3", "network": {"id": "d4f65670-c099-417c-97c5-e3233f89a476", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1710572970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fd26edea684a8d997c1b577ff8d859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a819f-2d", "ovs_interfaceid": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:08:27 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Converting VIF {"id": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "address": "fa:16:3e:cc:b0:d3", "network": {"id": "d4f65670-c099-417c-97c5-e3233f89a476", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1710572970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.82", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "63fd26edea684a8d997c1b577ff8d859", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74a819f-2d", "ovs_interfaceid": "a74a819f-2d80-4dca-bf03-eb6bf80868ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:08:27 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:b0:d3,bridge_name='br-int',has_traffic_filtering=True,id=a74a819f-2d80-4dca-bf03-eb6bf80868ba,network=Network(d4f65670-c099-417c-97c5-e3233f89a476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74a819f-2d') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:08:27 user nova-compute[74646]: DEBUG os_vif [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:b0:d3,bridge_name='br-int',has_traffic_filtering=True,id=a74a819f-2d80-4dca-bf03-eb6bf80868ba,network=Network(d4f65670-c099-417c-97c5-e3233f89a476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74a819f-2d') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:08:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa74a819f-2d, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:08:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:08:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=35a68a0a-7f6b-4793-8cb2-d1257d4e7ca4) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:08:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:27 user nova-compute[74646]: INFO os_vif [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:b0:d3,bridge_name='br-int',has_traffic_filtering=True,id=a74a819f-2d80-4dca-bf03-eb6bf80868ba,network=Network(d4f65670-c099-417c-97c5-e3233f89a476),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74a819f-2d')
Oct 26 16:08:27 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Deleting instance files /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0_del
Oct 26 16:08:27 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Deletion of /opt/stack/data/nova/instances/89f3a200-afb7-4c79-a6a1-5a1b434aeaa0_del complete
Oct 26 16:08:27 user nova-compute[74646]: INFO nova.compute.manager [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 26 16:08:27 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:08:27 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:08:27 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:08:28 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Took 1.01 seconds to deallocate network for instance.
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.compute.manager [req-8eef6a64-cf8f-4beb-b972-361ee86fb4e5 req-df3cd4ab-f7c3-4a91-9b74-b192b75460de service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Received event network-vif-deleted-a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:08:28 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Creating image(s)
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Ensure instance console log exists: /opt/stack/data/nova/instances/92c76eb3-f5d6-4233-97d3-55f0a944f798/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Start _get_guest_xml network_info=[{"id": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "address": "fa:16:3e:12:fd:2d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aae00e0-f0", "ovs_interfaceid": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-26T16:07:41Z,direct_url=<?>,disk_format='qcow2',id=c8b41abc-741f-4623-9769-344ad4144248,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2086327427',owner='a984c8da90ff476191cd5aa5787032c1',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-26T16:07:43Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '207db478-ad30-44e2-bd14-42a6669f8dc2', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'coRGeKJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '92c76eb3-f5d6-4233-97d3-55f0a944f798', 'attached_at': '', 'detached_at': '', 'volume_id': '7979d2f4-2805-4731-93ea-16010a980827', 'serial': '7979d2f4-2805-4731-93ea-16010a980827'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:08:28 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:08:28 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-26T16:07:41Z,direct_url=<?>,disk_format='qcow2',id=c8b41abc-741f-4623-9769-344ad4144248,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2086327427',owner='a984c8da90ff476191cd5aa5787032c1',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-26T16:07:43Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'coRGeKJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:08:28 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:08:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:08:28 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:08:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:08:28 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fb98b52-d43c-4b1b-9b27-7b11e947d252]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:08:28 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a368316-7dfd-45ec-a6da-aa770992313f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827] added
Oct 26 16:08:28 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f188fac-f7ee-4249-bc69-4afe8b0392b7]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6622c2a9-f737-4d61-9c96-0577ec45cfa6]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v coRGeKJD {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v coRGeKJD" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f4b9ab-24aa-45ed-ab5a-25e753fec1a7]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'coRGeKJD'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.compute.manager [req-3484aeb9-f177-4610-969e-515ca50c8729 req-e80ce09e-56cb-4283-9be1-b34db39e52d4 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Received event network-vif-plugged-a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3484aeb9-f177-4610-969e-515ca50c8729 req-e80ce09e-56cb-4283-9be1-b34db39e52d4 service nova] Acquiring lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3484aeb9-f177-4610-969e-515ca50c8729 req-e80ce09e-56cb-4283-9be1-b34db39e52d4 service nova] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3484aeb9-f177-4610-969e-515ca50c8729 req-e80ce09e-56cb-4283-9be1-b34db39e52d4 service nova] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG nova.compute.manager [req-3484aeb9-f177-4610-969e-515ca50c8729 req-e80ce09e-56cb-4283-9be1-b34db39e52d4 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] No waiting events found dispatching network-vif-plugged-a74a819f-2d80-4dca-bf03-eb6bf80868ba {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:08:28 user nova-compute[74646]: WARNING nova.compute.manager [req-3484aeb9-f177-4610-969e-515ca50c8729 req-e80ce09e-56cb-4283-9be1-b34db39e52d4 service nova] [instance: 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0] Received unexpected event network-vif-plugged-a74a819f-2d80-4dca-bf03-eb6bf80868ba for instance with vm_state deleted and task_state None.
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b7937d0-a3ac-47b0-993a-cd471e51a368]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8b5e05-7e4e-4d85-b269-683dcf7b22bc]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:08:29 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:08:29 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:29 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Deleted allocations for instance 89f3a200-afb7-4c79-a6a1-5a1b434aeaa0
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d7e6c6-43b3-46b3-a6ce-7a685f61a77c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827, portal: 172.16.0.220,3260]
Oct 26 16:08:29 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827, portal: 172.16.0.220,3260] successful.
Oct 26 16:08:29 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64705fd-35f6-4ba3-8f35-9da4d89ce304]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-1307062a-fbeb-4e8f-a0dd-59ebc5e327d9 tempest-SnapshotDataIntegrityTests-204349635 tempest-SnapshotDataIntegrityTests-204349635-project-member] Lock "89f3a200-afb7-4c79-a6a1-5a1b434aeaa0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.668s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa8c7d4-fbc0-4722-9905-dcea9b2b35b8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)
Oct 26 16:08:29 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:08:29 user nova-compute[74646]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)
Oct 26 16:08:29 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.345s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] HCTL ('38', '-', '-', 0) found on session 39 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[403f8bc5-9393-49cd-8eeb-387d817ce486]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'coRGeKJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Rebuilding the list of instances to heal {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Skipping network cache update for instance because it is Building. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:08:29 user nova-compute[74646]: DEBUG nova.objects.instance [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lazy-loading 'info_cache' on Instance uuid 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updating instance_info_cache with network_info: [{"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23032323266333464', 'path': '/dev/sdg'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032323266333464', 'path': '/dev/sdg'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1908508336',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1908508336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1908508336',id=34,image_ref='c8b41abc-741f-4623-9769-344ad4144248',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6GwjqD8y+u9e5jTSxX3jinGmEKIzgy3cBB2jOyGfipVaZBGEU4mGV8lCjoFcBdNIkuRQ7zJY5tYHxwDcZIWyfSiK7lmRUv83X0c3I2hSsfMKcf1LpPoDBCw+VzCapjeQ==',key_name='tempest-keypair-185895398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-4665p37x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1231840017',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9419f9603ca647269ed1cf42e233507f',uuid=92c76eb3-f5d6-4233-97d3-55f0a944f798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "address": "fa:16:3e:12:fd:2d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aae00e0-f0", "ovs_interfaceid": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "address": "fa:16:3e:12:fd:2d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aae00e0-f0", "ovs_interfaceid": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:fd:2d,bridge_name='br-int',has_traffic_filtering=True,id=2aae00e0-f06a-495d-a4f8-90dadf9d67e8,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aae00e0-f0') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG nova.objects.instance [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lazy-loading 'pci_devices' on Instance uuid 92c76eb3-f5d6-4233-97d3-55f0a944f798 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:08:30 user nova-compute[74646]:   <uuid>92c76eb3-f5d6-4233-97d3-55f0a944f798</uuid>
Oct 26 16:08:30 user nova-compute[74646]:   <name>instance-00000022</name>
Oct 26 16:08:30 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:08:30 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:08:30 user nova-compute[74646]:   <metadata>
Oct 26 16:08:30 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:08:30 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:08:30 user nova-compute[74646]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1908508336</nova:name>
Oct 26 16:08:30 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:08:28</nova:creationTime>
Oct 26 16:08:30 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:08:30 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:08:30 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:08:30 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:08:30 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:08:30 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:08:30 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:08:30 user nova-compute[74646]:       <nova:owner>
Oct 26 16:08:30 user nova-compute[74646]:         <nova:user uuid="9419f9603ca647269ed1cf42e233507f">tempest-TestVolumeBootPattern-1231840017-project-member</nova:user>
Oct 26 16:08:30 user nova-compute[74646]:         <nova:project uuid="a984c8da90ff476191cd5aa5787032c1">tempest-TestVolumeBootPattern-1231840017</nova:project>
Oct 26 16:08:30 user nova-compute[74646]:       </nova:owner>
Oct 26 16:08:30 user nova-compute[74646]:       <nova:root type="image" uuid="c8b41abc-741f-4623-9769-344ad4144248"/>
Oct 26 16:08:30 user nova-compute[74646]:       <nova:ports>
Oct 26 16:08:30 user nova-compute[74646]:         <nova:port uuid="2aae00e0-f06a-495d-a4f8-90dadf9d67e8">
Oct 26 16:08:30 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 26 16:08:30 user nova-compute[74646]:         </nova:port>
Oct 26 16:08:30 user nova-compute[74646]:       </nova:ports>
Oct 26 16:08:30 user nova-compute[74646]:     </nova:instance>
Oct 26 16:08:30 user nova-compute[74646]:   </metadata>
Oct 26 16:08:30 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:08:30 user nova-compute[74646]:     <system>
Oct 26 16:08:30 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:08:30 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:08:30 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:08:30 user nova-compute[74646]:       <entry name="serial">92c76eb3-f5d6-4233-97d3-55f0a944f798</entry>
Oct 26 16:08:30 user nova-compute[74646]:       <entry name="uuid">92c76eb3-f5d6-4233-97d3-55f0a944f798</entry>
Oct 26 16:08:30 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:08:30 user nova-compute[74646]:     </system>
Oct 26 16:08:30 user nova-compute[74646]:   </sysinfo>
Oct 26 16:08:30 user nova-compute[74646]:   <os>
Oct 26 16:08:30 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:08:30 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:08:30 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:08:30 user nova-compute[74646]:   </os>
Oct 26 16:08:30 user nova-compute[74646]:   <features>
Oct 26 16:08:30 user nova-compute[74646]:     <acpi/>
Oct 26 16:08:30 user nova-compute[74646]:     <apic/>
Oct 26 16:08:30 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:08:30 user nova-compute[74646]:   </features>
Oct 26 16:08:30 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:08:30 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:08:30 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:08:30 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:08:30 user nova-compute[74646]:   </clock>
Oct 26 16:08:30 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:08:30 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:08:30 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:08:30 user nova-compute[74646]:   </cpu>
Oct 26 16:08:30 user nova-compute[74646]:   <devices>
Oct 26 16:08:30 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:08:30 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:08:30 user nova-compute[74646]:       <source dev="/dev/sdg"/>
Oct 26 16:08:30 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:08:30 user nova-compute[74646]:       <serial>7979d2f4-2805-4731-93ea-16010a980827</serial>
Oct 26 16:08:30 user nova-compute[74646]:     </disk>
Oct 26 16:08:30 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:08:30 user nova-compute[74646]:       <mac address="fa:16:3e:12:fd:2d"/>
Oct 26 16:08:30 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:08:30 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:08:30 user nova-compute[74646]:       <target dev="tap2aae00e0-f0"/>
Oct 26 16:08:30 user nova-compute[74646]:     </interface>
Oct 26 16:08:30 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:08:30 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/92c76eb3-f5d6-4233-97d3-55f0a944f798/console.log" append="off"/>
Oct 26 16:08:30 user nova-compute[74646]:     </serial>
Oct 26 16:08:30 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:08:30 user nova-compute[74646]:     <video>
Oct 26 16:08:30 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:08:30 user nova-compute[74646]:     </video>
Oct 26 16:08:30 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:08:30 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:08:30 user nova-compute[74646]:     </rng>
Oct 26 16:08:30 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:08:30 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:08:30 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:08:30 user nova-compute[74646]:     </memballoon>
Oct 26 16:08:30 user nova-compute[74646]:   </devices>
Oct 26 16:08:30 user nova-compute[74646]: </domain>
Oct 26 16:08:30 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1908508336',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1908508336',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1908508336',id=34,image_ref='c8b41abc-741f-4623-9769-344ad4144248',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6GwjqD8y+u9e5jTSxX3jinGmEKIzgy3cBB2jOyGfipVaZBGEU4mGV8lCjoFcBdNIkuRQ7zJY5tYHxwDcZIWyfSiK7lmRUv83X0c3I2hSsfMKcf1LpPoDBCw+VzCapjeQ==',key_name='tempest-keypair-185895398',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-4665p37x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1231840017',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:07:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9419f9603ca647269ed1cf42e233507f',uuid=92c76eb3-f5d6-4233-97d3-55f0a944f798,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "address": "fa:16:3e:12:fd:2d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aae00e0-f0", "ovs_interfaceid": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "address": "fa:16:3e:12:fd:2d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aae00e0-f0", "ovs_interfaceid": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:fd:2d,bridge_name='br-int',has_traffic_filtering=True,id=2aae00e0-f06a-495d-a4f8-90dadf9d67e8,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aae00e0-f0') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG os_vif [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:fd:2d,bridge_name='br-int',has_traffic_filtering=True,id=2aae00e0-f06a-495d-a4f8-90dadf9d67e8,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aae00e0-f0') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b0ace31-b39d-5989-8438-72af4d73161e', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2aae00e0-f0, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2aae00e0-f0, col_values=(('qos', UUID('278df59b-c054-4da8-bbd6-486b43eee5d5')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2aae00e0-f0, col_values=(('external_ids', {'iface-id': '2aae00e0-f06a-495d-a4f8-90dadf9d67e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:12:fd:2d', 'vm-uuid': '92c76eb3-f5d6-4233-97d3-55f0a944f798'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:30 user nova-compute[74646]: INFO os_vif [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:fd:2d,bridge_name='br-int',has_traffic_filtering=True,id=2aae00e0-f06a-495d-a4f8-90dadf9d67e8,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aae00e0-f0')
Oct 26 16:08:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] No VIF found with MAC fa:16:3e:12:fd:2d, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:08:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG nova.compute.manager [req-c5c2332c-8e10-42ba-a044-828e6b472695 req-6af376ca-8c11-4aa5-9662-1e2c28d208a7 service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Received event network-vif-plugged-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c5c2332c-8e10-42ba-a044-828e6b472695 req-6af376ca-8c11-4aa5-9662-1e2c28d208a7 service nova] Acquiring lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c5c2332c-8e10-42ba-a044-828e6b472695 req-6af376ca-8c11-4aa5-9662-1e2c28d208a7 service nova] Lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c5c2332c-8e10-42ba-a044-828e6b472695 req-6af376ca-8c11-4aa5-9662-1e2c28d208a7 service nova] Lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG nova.compute.manager [req-c5c2332c-8e10-42ba-a044-828e6b472695 req-6af376ca-8c11-4aa5-9662-1e2c28d208a7 service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] No waiting events found dispatching network-vif-plugged-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:08:31 user nova-compute[74646]: WARNING nova.compute.manager [req-c5c2332c-8e10-42ba-a044-828e6b472695 req-6af376ca-8c11-4aa5-9662-1e2c28d208a7 service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Received unexpected event network-vif-plugged-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 for instance with vm_state building and task_state spawning.
Oct 26 16:08:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:33 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:08:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:08:33 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Instance spawned successfully.
Oct 26 16:08:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:08:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:08:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:08:33 user nova-compute[74646]: INFO nova.compute.manager [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Took 5.14 seconds to spawn the instance on the hypervisor.
Oct 26 16:08:33 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:08:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-4e496c55-e30c-407e-bed3-f6c6a0bfcacb req-2ff60e28-2565-46a0-bca2-3ee022b7dafe service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Received event network-vif-plugged-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:08:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4e496c55-e30c-407e-bed3-f6c6a0bfcacb req-2ff60e28-2565-46a0-bca2-3ee022b7dafe service nova] Acquiring lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4e496c55-e30c-407e-bed3-f6c6a0bfcacb req-2ff60e28-2565-46a0-bca2-3ee022b7dafe service nova] Lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4e496c55-e30c-407e-bed3-f6c6a0bfcacb req-2ff60e28-2565-46a0-bca2-3ee022b7dafe service nova] Lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-4e496c55-e30c-407e-bed3-f6c6a0bfcacb req-2ff60e28-2565-46a0-bca2-3ee022b7dafe service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] No waiting events found dispatching network-vif-plugged-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:08:33 user nova-compute[74646]: WARNING nova.compute.manager [req-4e496c55-e30c-407e-bed3-f6c6a0bfcacb req-2ff60e28-2565-46a0-bca2-3ee022b7dafe service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Received unexpected event network-vif-plugged-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 for instance with vm_state building and task_state spawning.
Oct 26 16:08:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:08:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:34 user nova-compute[74646]: INFO nova.compute.manager [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Took 36.99 seconds to build instance.
Oct 26 16:08:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2957399c-b6f4-4a08-947d-8cc3dfd6e818 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "92c76eb3-f5d6-4233-97d3-55f0a944f798" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.195s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:08:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.rescue --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.rescue --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:08:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:08:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:08:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:08:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:08:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:08:37 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:08:37 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7588MB free_disk=25.065166473388672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9afc1e60-016b-4505-a123-8ec2f4311d84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 670508e6-ee5a-4aa9-bb9a-a696205174b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b4286998-93f6-439c-9c4e-b710d121420b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9e46d857-97e1-40a0-9232-57438a82f8c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 511f84be-7779-4856-8611-9171c1b59d58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 0c285c4b-4895-424b-867d-af1fd8e6d151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 92c76eb3-f5d6-4233-97d3-55f0a944f798 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:08:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.532s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-35ead76f-6294-46a5-a062-7be88e01e622 req-479cc95d-5740-4cf8-b069-c91b06957f79 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-changed-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:08:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-35ead76f-6294-46a5-a062-7be88e01e622 req-479cc95d-5740-4cf8-b069-c91b06957f79 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Refreshing instance network info cache due to event network-changed-54ef776d-25f3-4729-98c1-6ecc9029e55e. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:08:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-35ead76f-6294-46a5-a062-7be88e01e622 req-479cc95d-5740-4cf8-b069-c91b06957f79 service nova] Acquiring lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:08:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-35ead76f-6294-46a5-a062-7be88e01e622 req-479cc95d-5740-4cf8-b069-c91b06957f79 service nova] Acquired lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:08:39 user nova-compute[74646]: DEBUG nova.network.neutron [req-35ead76f-6294-46a5-a062-7be88e01e622 req-479cc95d-5740-4cf8-b069-c91b06957f79 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Refreshing network info cache for port 54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:08:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:40 user nova-compute[74646]: DEBUG nova.network.neutron [req-35ead76f-6294-46a5-a062-7be88e01e622 req-479cc95d-5740-4cf8-b069-c91b06957f79 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Updated VIF entry in instance network info cache for port 54ef776d-25f3-4729-98c1-6ecc9029e55e. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:08:40 user nova-compute[74646]: DEBUG nova.network.neutron [req-35ead76f-6294-46a5-a062-7be88e01e622 req-479cc95d-5740-4cf8-b069-c91b06957f79 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Updating instance_info_cache with network_info: [{"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:08:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-35ead76f-6294-46a5-a062-7be88e01e622 req-479cc95d-5740-4cf8-b069-c91b06957f79 service nova] Releasing lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:08:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-c9366170-5cd9-4293-8aee-a1180c596111 req-2cbd248f-e9a8-4ed5-b2e1-0b2d56f39bc5 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-changed-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:08:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-c9366170-5cd9-4293-8aee-a1180c596111 req-2cbd248f-e9a8-4ed5-b2e1-0b2d56f39bc5 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Refreshing instance network info cache due to event network-changed-54ef776d-25f3-4729-98c1-6ecc9029e55e. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:08:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c9366170-5cd9-4293-8aee-a1180c596111 req-2cbd248f-e9a8-4ed5-b2e1-0b2d56f39bc5 service nova] Acquiring lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:08:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c9366170-5cd9-4293-8aee-a1180c596111 req-2cbd248f-e9a8-4ed5-b2e1-0b2d56f39bc5 service nova] Acquired lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:08:40 user nova-compute[74646]: DEBUG nova.network.neutron [req-c9366170-5cd9-4293-8aee-a1180c596111 req-2cbd248f-e9a8-4ed5-b2e1-0b2d56f39bc5 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Refreshing network info cache for port 54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:08:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:40 user nova-compute[74646]: INFO nova.compute.manager [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Detaching volume 00d0f839-ae84-49dc-a16f-530f1e9ee481
Oct 26 16:08:40 user nova-compute[74646]: INFO nova.virt.block_device [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Attempting to driver detach volume 00d0f839-ae84-49dc-a16f-530f1e9ee481 from mountpoint /dev/vdb
Oct 26 16:08:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Attempting to detach device vdb from instance 670508e6-ee5a-4aa9-bb9a-a696205174b8 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:08:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:08:41 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:08:41 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 16:08:41 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:08:41 user nova-compute[74646]:   <serial>00d0f839-ae84-49dc-a16f-530f1e9ee481</serial>
Oct 26 16:08:41 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:08:41 user nova-compute[74646]: </disk>
Oct 26 16:08:41 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:08:41 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Successfully detached device vdb from instance 670508e6-ee5a-4aa9-bb9a-a696205174b8 from the persistent domain config.
Oct 26 16:08:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 670508e6-ee5a-4aa9-bb9a-a696205174b8 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:08:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:08:41 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:08:41 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 16:08:41 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:08:41 user nova-compute[74646]:   <serial>00d0f839-ae84-49dc-a16f-530f1e9ee481</serial>
Oct 26 16:08:41 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:08:41 user nova-compute[74646]: </disk>
Oct 26 16:08:41 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:08:41 user nova-compute[74646]: DEBUG nova.network.neutron [req-c9366170-5cd9-4293-8aee-a1180c596111 req-2cbd248f-e9a8-4ed5-b2e1-0b2d56f39bc5 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Updated VIF entry in instance network info cache for port 54ef776d-25f3-4729-98c1-6ecc9029e55e. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:08:41 user nova-compute[74646]: DEBUG nova.network.neutron [req-c9366170-5cd9-4293-8aee-a1180c596111 req-2cbd248f-e9a8-4ed5-b2e1-0b2d56f39bc5 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Updating instance_info_cache with network_info: [{"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:08:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c9366170-5cd9-4293-8aee-a1180c596111 req-2cbd248f-e9a8-4ed5-b2e1-0b2d56f39bc5 service nova] Releasing lock "refresh_cache-670508e6-ee5a-4aa9-bb9a-a696205174b8" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:08:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 670508e6-ee5a-4aa9-bb9a-a696205174b8 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:08:41 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:08:41 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:08:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:45 user nova-compute[74646]: INFO nova.compute.manager [None req-077fede3-cd96-42f6-9a64-b0e117480bd8 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Unrescuing
Oct 26 16:08:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-077fede3-cd96-42f6-9a64-b0e117480bd8 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:08:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-077fede3-cd96-42f6-9a64-b0e117480bd8 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquired lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:08:45 user nova-compute[74646]: DEBUG nova.network.neutron [None req-077fede3-cd96-42f6-9a64-b0e117480bd8 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:08:46 user nova-compute[74646]: DEBUG nova.network.neutron [None req-077fede3-cd96-42f6-9a64-b0e117480bd8 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Updating instance_info_cache with network_info: [{"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:08:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-077fede3-cd96-42f6-9a64-b0e117480bd8 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Releasing lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:08:46 user nova-compute[74646]: DEBUG nova.objects.instance [None req-077fede3-cd96-42f6-9a64-b0e117480bd8 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lazy-loading 'flavor' on Instance uuid 9afc1e60-016b-4505-a123-8ec2f4311d84 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:08:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:47 user nova-compute[74646]: DEBUG nova.compute.manager [req-8150e609-12d8-469f-9c5e-6edfe84a22e4 req-26734bbe-c4f6-48bc-9bdf-ed929621f922 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-vif-unplugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:08:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8150e609-12d8-469f-9c5e-6edfe84a22e4 req-26734bbe-c4f6-48bc-9bdf-ed929621f922 service nova] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8150e609-12d8-469f-9c5e-6edfe84a22e4 req-26734bbe-c4f6-48bc-9bdf-ed929621f922 service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8150e609-12d8-469f-9c5e-6edfe84a22e4 req-26734bbe-c4f6-48bc-9bdf-ed929621f922 service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:47 user nova-compute[74646]: DEBUG nova.compute.manager [req-8150e609-12d8-469f-9c5e-6edfe84a22e4 req-26734bbe-c4f6-48bc-9bdf-ed929621f922 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] No waiting events found dispatching network-vif-unplugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:08:47 user nova-compute[74646]: WARNING nova.compute.manager [req-8150e609-12d8-469f-9c5e-6edfe84a22e4 req-26734bbe-c4f6-48bc-9bdf-ed929621f922 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received unexpected event network-vif-unplugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a for instance with vm_state rescued and task_state unrescuing.
Oct 26 16:08:47 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Instance destroyed successfully.
Oct 26 16:08:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG nova.compute.manager [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG nova.compute.manager [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] No waiting events found dispatching network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:08:49 user nova-compute[74646]: WARNING nova.compute.manager [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received unexpected event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a for instance with vm_state rescued and task_state unrescuing.
Oct 26 16:08:49 user nova-compute[74646]: DEBUG nova.compute.manager [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-changed-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG nova.compute.manager [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Refreshing instance network info cache due to event network-changed-6ac5e586-1f3c-4057-8e24-73a8d6de614a. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] Acquiring lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] Acquired lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG nova.network.neutron [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Refreshing network info cache for port 6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG nova.network.neutron [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Updated VIF entry in instance network info cache for port 6ac5e586-1f3c-4057-8e24-73a8d6de614a. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG nova.network.neutron [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Updating instance_info_cache with network_info: [{"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] Releasing lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG nova.compute.manager [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-changed-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG nova.compute.manager [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Refreshing instance network info cache due to event network-changed-6ac5e586-1f3c-4057-8e24-73a8d6de614a. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] Acquiring lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] Acquired lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:08:49 user nova-compute[74646]: DEBUG nova.network.neutron [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Refreshing network info cache for port 6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:08:50 user nova-compute[74646]: DEBUG nova.network.neutron [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Updated VIF entry in instance network info cache for port 6ac5e586-1f3c-4057-8e24-73a8d6de614a. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:08:50 user nova-compute[74646]: DEBUG nova.network.neutron [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Updating instance_info_cache with network_info: [{"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:08:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] Releasing lock "refresh_cache-9afc1e60-016b-4505-a123-8ec2f4311d84" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:08:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:08:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] No waiting events found dispatching network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:08:50 user nova-compute[74646]: WARNING nova.compute.manager [req-38392d28-d8e8-4419-a5b3-eac33a04d6a9 req-a68617e7-00b4-4600-9cec-1b730f24c418 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received unexpected event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a for instance with vm_state rescued and task_state unrescuing.
Oct 26 16:08:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:51 user nova-compute[74646]: DEBUG nova.compute.manager [None req-077fede3-cd96-42f6-9a64-b0e117480bd8 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:08:51 user nova-compute[74646]: DEBUG nova.compute.manager [req-18e7bc48-8e6c-47de-863a-84c913d7f84c req-9d58bee1-791b-477e-8ffb-f6462a012fb3 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:08:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-18e7bc48-8e6c-47de-863a-84c913d7f84c req-9d58bee1-791b-477e-8ffb-f6462a012fb3 service nova] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:08:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-18e7bc48-8e6c-47de-863a-84c913d7f84c req-9d58bee1-791b-477e-8ffb-f6462a012fb3 service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:08:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-18e7bc48-8e6c-47de-863a-84c913d7f84c req-9d58bee1-791b-477e-8ffb-f6462a012fb3 service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:08:51 user nova-compute[74646]: DEBUG nova.compute.manager [req-18e7bc48-8e6c-47de-863a-84c913d7f84c req-9d58bee1-791b-477e-8ffb-f6462a012fb3 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] No waiting events found dispatching network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:08:51 user nova-compute[74646]: WARNING nova.compute.manager [req-18e7bc48-8e6c-47de-863a-84c913d7f84c req-9d58bee1-791b-477e-8ffb-f6462a012fb3 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received unexpected event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a for instance with vm_state rescued and task_state unrescuing.
Oct 26 16:08:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:08:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:01 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 670508e6-ee5a-4aa9-bb9a-a696205174b8 is timed out.
Oct 26 16:09:01 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Successfully detached device vdb from instance 670508e6-ee5a-4aa9-bb9a-a696205174b8 from the live domain config.
Oct 26 16:09:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oXHQamfx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:09:01 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf79885-ca72-4301-8264-2d20a9014fa1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:09:01 user nova-compute[74646]: No targets found.
Oct 26 16:09:01 user nova-compute[74646]: iSNS:
Oct 26 16:09:01 user nova-compute[74646]: No targets found.
Oct 26 16:09:01 user nova-compute[74646]: STATIC:
Oct 26 16:09:01 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827
Oct 26 16:09:01 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:01 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:01 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126
Oct 26 16:09:01 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:01 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:01 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:09:01 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:01 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:01 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f
Oct 26 16:09:01 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:01 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:01 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481
Oct 26 16:09:01 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:01 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:01 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b
Oct 26 16:09:01 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:01 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:01 user nova-compute[74646]: FIRMWARE:
Oct 26 16:09:01 user nova-compute[74646]: No targets found.
Oct 26 16:09:01 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:09:01 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:09:01 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd7a001-b75b-427f-9808-1c6fef46a994]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2607c1-0b1e-4bfa-b53e-8b30719630e5]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:09:01 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:09:01 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:09:01 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:09:01 user nova-compute[74646]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:09:01 user nova-compute[74646]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)
Oct 26 16:09:01 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:09:01 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:09:01 user nova-compute[74646]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 (non-flash)
Oct 26 16:09:01 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:09:01 user nova-compute[74646]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:09:01 user nova-compute[74646]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)
Oct 26 16:09:01 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e81c8dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481'): ({'sdc'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Removing single pathed devices sdc {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.214s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[88100e6b-8814-488c-ae71-9941a0cdd28c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1dee3b-b1d1-499c-abb7-81de2e529afd]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Flushing IO for device /dev/sdc {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22f39bd-8f06-4099-9bcf-9020cb48a979]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.066s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af34196-4b88-4628-a006-b8338009a110]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f7368e-021b-4e23-b3a4-7e3430132944]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[647db3f2-fb90-43af-878e-194feadfbc0c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481, portal: 172.16.0.220,3260]
Oct 26 16:09:02 user nova-compute[74646]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481, portal: 172.16.0.220,3260] successful.
Oct 26 16:09:02 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00d0f839-ae84-49dc-a16f-530f1e9ee481 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[25351bef-0f6c-4f6d-a110-525232dd53a1]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.574s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:09:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] <== disconnect_volume: return (576ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:09:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:09:03 user nova-compute[74646]: DEBUG nova.objects.instance [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lazy-loading 'flavor' on Instance uuid 670508e6-ee5a-4aa9-bb9a-a696205174b8 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:09:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8a7c9c6e-0945-4208-ad82-c126fe3e3ac8 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.291s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-420b55a5-4c86-423b-ab0b-c8ce774c4041 req-6aab4cfd-9a2d-449b-b022-b84f01b164a6 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received event network-changed-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:09:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-420b55a5-4c86-423b-ab0b-c8ce774c4041 req-6aab4cfd-9a2d-449b-b022-b84f01b164a6 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Refreshing instance network info cache due to event network-changed-ade5aae8-edfd-4f46-b943-e261afcc76f0. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:09:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-420b55a5-4c86-423b-ab0b-c8ce774c4041 req-6aab4cfd-9a2d-449b-b022-b84f01b164a6 service nova] Acquiring lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:09:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-420b55a5-4c86-423b-ab0b-c8ce774c4041 req-6aab4cfd-9a2d-449b-b022-b84f01b164a6 service nova] Acquired lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:09:06 user nova-compute[74646]: DEBUG nova.network.neutron [req-420b55a5-4c86-423b-ab0b-c8ce774c4041 req-6aab4cfd-9a2d-449b-b022-b84f01b164a6 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Refreshing network info cache for port ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:09:07 user nova-compute[74646]: DEBUG nova.network.neutron [req-420b55a5-4c86-423b-ab0b-c8ce774c4041 req-6aab4cfd-9a2d-449b-b022-b84f01b164a6 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updated VIF entry in instance network info cache for port ade5aae8-edfd-4f46-b943-e261afcc76f0. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:09:07 user nova-compute[74646]: DEBUG nova.network.neutron [req-420b55a5-4c86-423b-ab0b-c8ce774c4041 req-6aab4cfd-9a2d-449b-b022-b84f01b164a6 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updating instance_info_cache with network_info: [{"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:09:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-420b55a5-4c86-423b-ab0b-c8ce774c4041 req-6aab4cfd-9a2d-449b-b022-b84f01b164a6 service nova] Releasing lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:09:08 user nova-compute[74646]: DEBUG nova.compute.manager [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Stashing vm_state: active {{(pid=74646) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 26 16:09:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:08 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:09:08 user nova-compute[74646]: INFO nova.compute.claims [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Claim successful on node user
Oct 26 16:09:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-5b95a126-aca5-4c2d-892a-b58d8d20cc09 req-e336f487-613d-4d2f-aeb4-8d854ff6fc71 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received event network-changed-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:09:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-5b95a126-aca5-4c2d-892a-b58d8d20cc09 req-e336f487-613d-4d2f-aeb4-8d854ff6fc71 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Refreshing instance network info cache due to event network-changed-898eb4a5-708b-4414-bc27-1413e1a1d978. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:09:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5b95a126-aca5-4c2d-892a-b58d8d20cc09 req-e336f487-613d-4d2f-aeb4-8d854ff6fc71 service nova] Acquiring lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:09:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5b95a126-aca5-4c2d-892a-b58d8d20cc09 req-e336f487-613d-4d2f-aeb4-8d854ff6fc71 service nova] Acquired lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:09:08 user nova-compute[74646]: DEBUG nova.network.neutron [req-5b95a126-aca5-4c2d-892a-b58d8d20cc09 req-e336f487-613d-4d2f-aeb4-8d854ff6fc71 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Refreshing network info cache for port 898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:09:08 user nova-compute[74646]: INFO nova.compute.resource_tracker [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updating resource usage from migration 00c116ee-9516-4212-b9a7-47bf8468bc3f
Oct 26 16:09:09 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:09:09 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:09:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.495s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:09 user nova-compute[74646]: INFO nova.compute.manager [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Migrating
Oct 26 16:09:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:09:09 user nova-compute[74646]: DEBUG nova.network.neutron [req-5b95a126-aca5-4c2d-892a-b58d8d20cc09 req-e336f487-613d-4d2f-aeb4-8d854ff6fc71 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updated VIF entry in instance network info cache for port 898eb4a5-708b-4414-bc27-1413e1a1d978. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:09:09 user nova-compute[74646]: DEBUG nova.network.neutron [req-5b95a126-aca5-4c2d-892a-b58d8d20cc09 req-e336f487-613d-4d2f-aeb4-8d854ff6fc71 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updating instance_info_cache with network_info: [{"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:09:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5b95a126-aca5-4c2d-892a-b58d8d20cc09 req-e336f487-613d-4d2f-aeb4-8d854ff6fc71 service nova] Releasing lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:09:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquired lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:09:09 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:09:09 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updating instance_info_cache with network_info: [{"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:09:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Releasing lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:09:09 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Starting migrate_disk_and_power_off {{(pid=74646) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-a999fab4-c2df-4ead-8673-5e7c7d60a1ad req-c6a5b604-0ae7-4d25-8a3c-8c8bb01ee7dd service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received event network-vif-unplugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a999fab4-c2df-4ead-8673-5e7c7d60a1ad req-c6a5b604-0ae7-4d25-8a3c-8c8bb01ee7dd service nova] Acquiring lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a999fab4-c2df-4ead-8673-5e7c7d60a1ad req-c6a5b604-0ae7-4d25-8a3c-8c8bb01ee7dd service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a999fab4-c2df-4ead-8673-5e7c7d60a1ad req-c6a5b604-0ae7-4d25-8a3c-8c8bb01ee7dd service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-a999fab4-c2df-4ead-8673-5e7c7d60a1ad req-c6a5b604-0ae7-4d25-8a3c-8c8bb01ee7dd service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] No waiting events found dispatching network-vif-unplugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:09:10 user nova-compute[74646]: WARNING nova.compute.manager [req-a999fab4-c2df-4ead-8673-5e7c7d60a1ad req-c6a5b604-0ae7-4d25-8a3c-8c8bb01ee7dd service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received unexpected event network-vif-unplugged-898eb4a5-708b-4414-bc27-1413e1a1d978 for instance with vm_state active and task_state resize_migrating.
Oct 26 16:09:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:10 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Instance destroyed successfully.
Oct 26 16:09:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-700043270',display_name='tempest-ServerActionsTestOtherA-server-700043270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-700043270',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFpQMuDQ9yV5cYwbhkTyRLOjZZ0Tl/sjjENeyylssja83c6EpW+JftZQ9mXXtyfrIqGGnek7tn477+zNOt3iNR5IPo2YdOD8TzgfFC3ul9nIufuOchmOZ60R0hjnHQdyg==',key_name='tempest-keypair-1269718539',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:07:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-an258biy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=9e46d857-97e1-40a0-9232-57438a82f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1749591084-network", "vif_mac": "fa:16:3e:c1:c7:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1749591084-network", "vif_mac": "fa:16:3e:c1:c7:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c7:e2,bridge_name='br-int',has_traffic_filtering=True,id=898eb4a5-708b-4414-bc27-1413e1a1d978,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898eb4a5-70') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_vif [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c7:e2,bridge_name='br-int',has_traffic_filtering=True,id=898eb4a5-708b-4414-bc27-1413e1a1d978,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898eb4a5-70') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap898eb4a5-70, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad53df8c-565a-4329-a1a8-7fa392183b9a) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:10 user nova-compute[74646]: INFO os_vif [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c7:e2,bridge_name='br-int',has_traffic_filtering=True,id=898eb4a5-708b-4414-bc27-1413e1a1d978,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898eb4a5-70')
Oct 26 16:09:10 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSPKulcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:09:10 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e475ace4-c132-49a4-8ca4-4c13f4722693]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:09:10 user nova-compute[74646]: No targets found.
Oct 26 16:09:10 user nova-compute[74646]: iSNS:
Oct 26 16:09:10 user nova-compute[74646]: No targets found.
Oct 26 16:09:10 user nova-compute[74646]: STATIC:
Oct 26 16:09:10 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827
Oct 26 16:09:10 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:10 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:10 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126
Oct 26 16:09:10 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:10 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:10 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:09:10 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:10 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:10 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f
Oct 26 16:09:10 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:10 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:10 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b
Oct 26 16:09:10 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:10 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:10 user nova-compute[74646]: FIRMWARE:
Oct 26 16:09:10 user nova-compute[74646]: No targets found.
Oct 26 16:09:10 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:09:10 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:09:10 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f33dfb0-0de4-431d-8472-acc29c97d056]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b9e001-39d3-4ebc-ab82-a808763d498a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:09:10 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:09:10 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:09:10 user nova-compute[74646]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:09:10 user nova-compute[74646]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)
Oct 26 16:09:10 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:09:10 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:09:10 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:09:10 user nova-compute[74646]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:09:10 user nova-compute[74646]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)
Oct 26 16:09:10 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e8653370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126'): ({'sdf'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Removing single pathed devices sdf {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b06b50-6922-4f4c-803c-75863abc18dd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.031s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7d0e8b-edf2-42ee-ad7b-7c7ea01e427a]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Flushing IO for device /dev/sdf {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd1fbc1-7921-4b42-9825-23957cecf610]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[41150e6d-6f0c-46dd-b61c-c24f0545760e]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] SCSI volumes sdf have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_21d42095', '/dev/disk/by-id/scsi-1SCST_BIO21d42095-60fd8342cf464f34', '/dev/disk/by-id/scsi-23630666438333432') {{(pid=85624) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 16:09:10 user nova-compute[74646]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_21d42095
Oct 26 16:09:10 user nova-compute[74646]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO21d42095-60fd8342cf464f34
Oct 26 16:09:10 user nova-compute[74646]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23630666438333432
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a8e858-e27f-4563-a0b6-1687f281da4c]: (4, None) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fb3642-12a1-4f8b-8c66-d5849d0c338b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f68895-5158-4c63-b885-c120d9df0074]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260]
Oct 26 16:09:11 user nova-compute[74646]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260] successful.
Oct 26 16:09:11 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b986a78-e8d4-4625-8b5f-be44a5bc69d2]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:09:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] <== disconnect_volume: return (355ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:09:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:09:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:09:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Port 898eb4a5-708b-4414-bc27-1413e1a1d978 binding to destination host user is already ACTIVE {{(pid=74646) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Oct 26 16:09:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-414c6b85-ca0c-499e-ae2e-012b46c4ae63 req-f6a49810-d136-4859-a7c2-799b60ed8242 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received event network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:09:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-414c6b85-ca0c-499e-ae2e-012b46c4ae63 req-f6a49810-d136-4859-a7c2-799b60ed8242 service nova] Acquiring lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-414c6b85-ca0c-499e-ae2e-012b46c4ae63 req-f6a49810-d136-4859-a7c2-799b60ed8242 service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-414c6b85-ca0c-499e-ae2e-012b46c4ae63 req-f6a49810-d136-4859-a7c2-799b60ed8242 service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-414c6b85-ca0c-499e-ae2e-012b46c4ae63 req-f6a49810-d136-4859-a7c2-799b60ed8242 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] No waiting events found dispatching network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:09:12 user nova-compute[74646]: WARNING nova.compute.manager [req-414c6b85-ca0c-499e-ae2e-012b46c4ae63 req-f6a49810-d136-4859-a7c2-799b60ed8242 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received unexpected event network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 for instance with vm_state active and task_state resize_migrating.
Oct 26 16:09:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:09:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquired lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:09:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:09:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updating instance_info_cache with network_info: [{"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Releasing lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG os_brick.utils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f43b1f-80fd-43b6-a15c-82a5bd1bd226]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdccc802-64d5-4d41-be08-80d9570978f5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5917e9fb-2367-4102-b1d1-9e3f54451d71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e9cf1e-fc5a-4fc7-81f2-23d131ecf970]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:09:13 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:09:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ee6cdd-f20c-4d77-8625-8429e8d9ea3b]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:09:13 user nova-compute[74646]: DEBUG os_brick.utils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:09:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:19 user nova-compute[74646]: INFO nova.compute.manager [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Detaching volume 1cfd75c6-3608-484e-ab17-71d7a115015f
Oct 26 16:09:19 user nova-compute[74646]: INFO nova.virt.block_device [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Attempting to driver detach volume 1cfd75c6-3608-484e-ab17-71d7a115015f from mountpoint /dev/vdb
Oct 26 16:09:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Attempting to detach device vdb from instance 9afc1e60-016b-4505-a123-8ec2f4311d84 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:09:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:09:19 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:09:19 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:09:19 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:09:19 user nova-compute[74646]:   <serial>1cfd75c6-3608-484e-ab17-71d7a115015f</serial>
Oct 26 16:09:19 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:09:19 user nova-compute[74646]: </disk>
Oct 26 16:09:19 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:09:19 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Successfully detached device vdb from instance 9afc1e60-016b-4505-a123-8ec2f4311d84 from the persistent domain config.
Oct 26 16:09:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9afc1e60-016b-4505-a123-8ec2f4311d84 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:09:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:09:19 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:09:19 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:09:19 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:09:19 user nova-compute[74646]:   <serial>1cfd75c6-3608-484e-ab17-71d7a115015f</serial>
Oct 26 16:09:19 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:09:19 user nova-compute[74646]: </disk>
Oct 26 16:09:19 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:09:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9afc1e60-016b-4505-a123-8ec2f4311d84 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:09:20 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:09:20 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Cleaning up deleted instances {{(pid=74646) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 16:09:20 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] There are 0 instances to clean {{(pid=74646) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 16:09:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:26 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:09:26 user nova-compute[74646]: DEBUG nova.compute.manager [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:09:27 user nova-compute[74646]: INFO nova.compute.manager [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] instance snapshotting
Oct 26 16:09:27 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Beginning live snapshot process
Oct 26 16:09:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json -f qcow2 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json -f qcow2 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9cyc_vkw/b024b3c2c74c454596b2042e7fba4553.delta 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:27 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp9cyc_vkw/b024b3c2c74c454596b2042e7fba4553.delta 1073741824" returned: 0 in 0.055s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:27 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 26 16:09:28 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:09:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 16:09:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74646) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 26 16:09:29 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 26 16:09:29 user nova-compute[74646]: DEBUG nova.privsep.utils [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74646) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 16:09:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9cyc_vkw/b024b3c2c74c454596b2042e7fba4553.delta /opt/stack/data/nova/instances/snapshots/tmp9cyc_vkw/b024b3c2c74c454596b2042e7fba4553 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp9cyc_vkw/b024b3c2c74c454596b2042e7fba4553.delta /opt/stack/data/nova/instances/snapshots/tmp9cyc_vkw/b024b3c2c74c454596b2042e7fba4553" returned: 0 in 0.635s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:29 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Snapshot extracted, beginning image upload
Oct 26 16:09:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:09:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:09:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:09:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:09:30 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1283575f-b614-42d5-b632-c1409f295207] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:09:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:09:30 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1283575f-b614-42d5-b632-c1409f295207] Updating instance_info_cache with network_info: [{"id": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "address": "fa:16:3e:1b:cc:e1", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap366498f3-12", "ovs_interfaceid": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:09:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:09:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1283575f-b614-42d5-b632-c1409f295207] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:09:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:09:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:09:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:09:31 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:09:31 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Cleaning up deleted instances with incomplete migration  {{(pid=74646) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:09:32 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Snapshot image upload complete
Oct 26 16:09:32 user nova-compute[74646]: INFO nova.compute.manager [None req-fade9070-4da9-485c-9226-ae62845c745b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Took 5.52 seconds to snapshot the instance on the hypervisor.
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Starting finish_migration {{(pid=74646) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Instance directory exists: not creating {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 16:09:32 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Creating image(s)
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Ensure instance console log exists: /opt/stack/data/nova/instances/9e46d857-97e1-40a0-9232-57438a82f8c6/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Start _get_guest_xml network_info=[{"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1749591084-network", "vif_mac": "fa:16:3e:c1:c7:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '048353fb-b4ff-4c5f-81ec-eea5e9b8877d', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSPKulcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '9e46d857-97e1-40a0-9232-57438a82f8c6', 'attached_at': '2023-10-26T16:09:32.000000', 'detached_at': '', 'volume_id': 'eb9b9e63-b7e0-464b-b69f-aeac55c6d126', 'serial': 'eb9b9e63-b7e0-464b-b69f-aeac55c6d126'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:09:32 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:09:32 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:28Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSPKulcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:09:32 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:09:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:09:32 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:09:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:09:32 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dce7eeb-7422-4a36-85ac-646d9c210e2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:09:32 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e4a34b-9b8c-47f0-b218-7eeaf4198970]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126] added
Oct 26 16:09:32 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[327c2305-628e-4013-9279-5d3fc490b46a]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c729d7-7ea6-4ea4-920f-43f96f9ca94b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HSPKulcT {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HSPKulcT" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b378d5-bac2-48d4-af79-2cca3c30a42e]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HSPKulcT'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:32 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b815b94-7b59-4a54-983e-e0a86d59dd42]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c95f7c-54ff-490d-8eea-8f66b6fe8b05]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:09:33 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:09:33 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:09:33 user nova-compute[74646]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)
Oct 26 16:09:33 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:09:33 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:09:33 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:09:33 user nova-compute[74646]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)
Oct 26 16:09:33 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e4eb27-6c21-49da-941e-9af9fc0770bc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260]
Oct 26 16:09:33 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260] successful.
Oct 26 16:09:33 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d0bf7c-0169-4ada-a2ab-95b1675728c6]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[349b89e4-4dcb-4821-b9cb-9d7a8edb22db]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:09:33 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:09:33 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:09:33 user nova-compute[74646]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)
Oct 26 16:09:33 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:09:33 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:09:33 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:09:33 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:09:33 user nova-compute[74646]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)
Oct 26 16:09:33 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:09:33 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d915904a-2b57-437c-8752-de20883b6d15]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSPKulcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-8aec7ae7-dbb6-4185-8d58-658416c94bc8 req-71c1d8a3-9dca-4dd8-ad0c-4d36d61ea8d5 service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Received event network-changed-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-8aec7ae7-dbb6-4185-8d58-658416c94bc8 req-71c1d8a3-9dca-4dd8-ad0c-4d36d61ea8d5 service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Refreshing instance network info cache due to event network-changed-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8aec7ae7-dbb6-4185-8d58-658416c94bc8 req-71c1d8a3-9dca-4dd8-ad0c-4d36d61ea8d5 service nova] Acquiring lock "refresh_cache-0c285c4b-4895-424b-867d-af1fd8e6d151" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8aec7ae7-dbb6-4185-8d58-658416c94bc8 req-71c1d8a3-9dca-4dd8-ad0c-4d36d61ea8d5 service nova] Acquired lock "refresh_cache-0c285c4b-4895-424b-867d-af1fd8e6d151" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG nova.network.neutron [req-8aec7ae7-dbb6-4185-8d58-658416c94bc8 req-71c1d8a3-9dca-4dd8-ad0c-4d36d61ea8d5 service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Refreshing network info cache for port 1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG nova.network.neutron [req-8aec7ae7-dbb6-4185-8d58-658416c94bc8 req-71c1d8a3-9dca-4dd8-ad0c-4d36d61ea8d5 service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Updated VIF entry in instance network info cache for port 1e37abb8-6088-435a-bf9c-9fd52dc2c4ab. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG nova.network.neutron [req-8aec7ae7-dbb6-4185-8d58-658416c94bc8 req-71c1d8a3-9dca-4dd8-ad0c-4d36d61ea8d5 service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Updating instance_info_cache with network_info: [{"id": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "address": "fa:16:3e:9a:e9:aa", "network": {"id": "5f672f1e-93ae-4952-a144-4b4e974c1ab8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1833332180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16026a9a67e34ea484655daa6a1a846e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e37abb8-60", "ovs_interfaceid": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8aec7ae7-dbb6-4185-8d58-658416c94bc8 req-71c1d8a3-9dca-4dd8-ad0c-4d36d61ea8d5 service nova] Releasing lock "refresh_cache-0c285c4b-4895-424b-867d-af1fd8e6d151" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.391s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] <== connect_volume: return (1393ms) {'type': 'block', 'scsi_wwn': '23630666438333432', 'path': '/dev/sdc'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23630666438333432', 'path': '/dev/sdc'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-700043270',display_name='tempest-ServerActionsTestOtherA-server-700043270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-700043270',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFpQMuDQ9yV5cYwbhkTyRLOjZZ0Tl/sjjENeyylssja83c6EpW+JftZQ9mXXtyfrIqGGnek7tn477+zNOt3iNR5IPo2YdOD8TzgfFC3ul9nIufuOchmOZ60R0hjnHQdyg==',key_name='tempest-keypair-1269718539',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:07:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-an258biy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=9e46d857-97e1-40a0-9232-57438a82f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1749591084-network", "vif_mac": "fa:16:3e:c1:c7:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1749591084-network", "vif_mac": "fa:16:3e:c1:c7:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:e2,bridge_name='br-int',has_traffic_filtering=True,id=898eb4a5-708b-4414-bc27-1413e1a1d978,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898eb4a5-70') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:09:34 user nova-compute[74646]:   <uuid>9e46d857-97e1-40a0-9232-57438a82f8c6</uuid>
Oct 26 16:09:34 user nova-compute[74646]:   <name>instance-0000001f</name>
Oct 26 16:09:34 user nova-compute[74646]:   <memory>2097152</memory>
Oct 26 16:09:34 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:09:34 user nova-compute[74646]:   <metadata>
Oct 26 16:09:34 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:09:34 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:09:34 user nova-compute[74646]:       <nova:name>tempest-ServerActionsTestOtherA-server-700043270</nova:name>
Oct 26 16:09:34 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:09:32</nova:creationTime>
Oct 26 16:09:34 user nova-compute[74646]:       <nova:flavor name="m1.small">
Oct 26 16:09:34 user nova-compute[74646]:         <nova:memory>2048</nova:memory>
Oct 26 16:09:34 user nova-compute[74646]:         <nova:disk>20</nova:disk>
Oct 26 16:09:34 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:09:34 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:09:34 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:09:34 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:09:34 user nova-compute[74646]:       <nova:owner>
Oct 26 16:09:34 user nova-compute[74646]:         <nova:user uuid="9311cee7c04e45ddbae6f16ba43eed2e">tempest-ServerActionsTestOtherA-333958340-project-member</nova:user>
Oct 26 16:09:34 user nova-compute[74646]:         <nova:project uuid="6c8788e95cc244f98b0ff8d593d1e067">tempest-ServerActionsTestOtherA-333958340</nova:project>
Oct 26 16:09:34 user nova-compute[74646]:       </nova:owner>
Oct 26 16:09:34 user nova-compute[74646]:       <nova:ports>
Oct 26 16:09:34 user nova-compute[74646]:         <nova:port uuid="898eb4a5-708b-4414-bc27-1413e1a1d978">
Oct 26 16:09:34 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 26 16:09:34 user nova-compute[74646]:         </nova:port>
Oct 26 16:09:34 user nova-compute[74646]:       </nova:ports>
Oct 26 16:09:34 user nova-compute[74646]:     </nova:instance>
Oct 26 16:09:34 user nova-compute[74646]:   </metadata>
Oct 26 16:09:34 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:09:34 user nova-compute[74646]:     <system>
Oct 26 16:09:34 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:09:34 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:09:34 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:09:34 user nova-compute[74646]:       <entry name="serial">9e46d857-97e1-40a0-9232-57438a82f8c6</entry>
Oct 26 16:09:34 user nova-compute[74646]:       <entry name="uuid">9e46d857-97e1-40a0-9232-57438a82f8c6</entry>
Oct 26 16:09:34 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:09:34 user nova-compute[74646]:     </system>
Oct 26 16:09:34 user nova-compute[74646]:   </sysinfo>
Oct 26 16:09:34 user nova-compute[74646]:   <os>
Oct 26 16:09:34 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:09:34 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:09:34 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:09:34 user nova-compute[74646]:   </os>
Oct 26 16:09:34 user nova-compute[74646]:   <features>
Oct 26 16:09:34 user nova-compute[74646]:     <acpi/>
Oct 26 16:09:34 user nova-compute[74646]:     <apic/>
Oct 26 16:09:34 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:09:34 user nova-compute[74646]:   </features>
Oct 26 16:09:34 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:09:34 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:09:34 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:09:34 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:09:34 user nova-compute[74646]:   </clock>
Oct 26 16:09:34 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:09:34 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:09:34 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:09:34 user nova-compute[74646]:   </cpu>
Oct 26 16:09:34 user nova-compute[74646]:   <devices>
Oct 26 16:09:34 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:09:34 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:09:34 user nova-compute[74646]:       <source dev="/dev/sdc"/>
Oct 26 16:09:34 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:09:34 user nova-compute[74646]:       <serial>eb9b9e63-b7e0-464b-b69f-aeac55c6d126</serial>
Oct 26 16:09:34 user nova-compute[74646]:     </disk>
Oct 26 16:09:34 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:09:34 user nova-compute[74646]:       <mac address="fa:16:3e:c1:c7:e2"/>
Oct 26 16:09:34 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:09:34 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:09:34 user nova-compute[74646]:       <target dev="tap898eb4a5-70"/>
Oct 26 16:09:34 user nova-compute[74646]:     </interface>
Oct 26 16:09:34 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:09:34 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/9e46d857-97e1-40a0-9232-57438a82f8c6/console.log" append="off"/>
Oct 26 16:09:34 user nova-compute[74646]:     </serial>
Oct 26 16:09:34 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:09:34 user nova-compute[74646]:     <video>
Oct 26 16:09:34 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:09:34 user nova-compute[74646]:     </video>
Oct 26 16:09:34 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:09:34 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:09:34 user nova-compute[74646]:     </rng>
Oct 26 16:09:34 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:09:34 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:09:34 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:09:34 user nova-compute[74646]:     </memballoon>
Oct 26 16:09:34 user nova-compute[74646]:   </devices>
Oct 26 16:09:34 user nova-compute[74646]: </domain>
Oct 26 16:09:34 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-700043270',display_name='tempest-ServerActionsTestOtherA-server-700043270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-700043270',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFpQMuDQ9yV5cYwbhkTyRLOjZZ0Tl/sjjENeyylssja83c6EpW+JftZQ9mXXtyfrIqGGnek7tn477+zNOt3iNR5IPo2YdOD8TzgfFC3ul9nIufuOchmOZ60R0hjnHQdyg==',key_name='tempest-keypair-1269718539',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:07:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-an258biy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:09:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=9e46d857-97e1-40a0-9232-57438a82f8c6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1749591084-network", "vif_mac": "fa:16:3e:c1:c7:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1749591084-network", "vif_mac": "fa:16:3e:c1:c7:e2"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:e2,bridge_name='br-int',has_traffic_filtering=True,id=898eb4a5-708b-4414-bc27-1413e1a1d978,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898eb4a5-70') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG os_vif [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:e2,bridge_name='br-int',has_traffic_filtering=True,id=898eb4a5-708b-4414-bc27-1413e1a1d978,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898eb4a5-70') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5eb73e16-20dc-51a0-bc73-5614296a99a7', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap898eb4a5-70, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap898eb4a5-70, col_values=(('qos', UUID('83f7c686-9e86-4a4d-8c0e-89c94a71db4e')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap898eb4a5-70, col_values=(('external_ids', {'iface-id': '898eb4a5-708b-4414-bc27-1413e1a1d978', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c1:c7:e2', 'vm-uuid': '9e46d857-97e1-40a0-9232-57438a82f8c6'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:34 user nova-compute[74646]: INFO os_vif [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c1:c7:e2,bridge_name='br-int',has_traffic_filtering=True,id=898eb4a5-708b-4414-bc27-1413e1a1d978,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898eb4a5-70')
Oct 26 16:09:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] No VIF found with MAC fa:16:3e:c1:c7:e2, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.manager [req-3819895b-72ea-44f0-9992-5eab1fa2f864 req-8331464e-b607-434b-ac7d-0ae8ee79974f service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received event network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3819895b-72ea-44f0-9992-5eab1fa2f864 req-8331464e-b607-434b-ac7d-0ae8ee79974f service nova] Acquiring lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3819895b-72ea-44f0-9992-5eab1fa2f864 req-8331464e-b607-434b-ac7d-0ae8ee79974f service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3819895b-72ea-44f0-9992-5eab1fa2f864 req-8331464e-b607-434b-ac7d-0ae8ee79974f service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.manager [req-3819895b-72ea-44f0-9992-5eab1fa2f864 req-8331464e-b607-434b-ac7d-0ae8ee79974f service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] No waiting events found dispatching network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:09:38 user nova-compute[74646]: WARNING nova.compute.manager [req-3819895b-72ea-44f0-9992-5eab1fa2f864 req-8331464e-b607-434b-ac7d-0ae8ee79974f service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received unexpected event network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 for instance with vm_state active and task_state resize_finish.
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.manager [req-e63be173-75a9-4300-ab26-6ed6bea05e18 req-ead10d3f-7ec1-4fa7-a60a-bf2fd5bd9032 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received event network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e63be173-75a9-4300-ab26-6ed6bea05e18 req-ead10d3f-7ec1-4fa7-a60a-bf2fd5bd9032 service nova] Acquiring lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e63be173-75a9-4300-ab26-6ed6bea05e18 req-ead10d3f-7ec1-4fa7-a60a-bf2fd5bd9032 service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e63be173-75a9-4300-ab26-6ed6bea05e18 req-ead10d3f-7ec1-4fa7-a60a-bf2fd5bd9032 service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.manager [req-e63be173-75a9-4300-ab26-6ed6bea05e18 req-ead10d3f-7ec1-4fa7-a60a-bf2fd5bd9032 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] No waiting events found dispatching network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:09:38 user nova-compute[74646]: WARNING nova.compute.manager [req-e63be173-75a9-4300-ab26-6ed6bea05e18 req-ead10d3f-7ec1-4fa7-a60a-bf2fd5bd9032 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received unexpected event network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 for instance with vm_state active and task_state resize_finish.
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.manager [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:09:38 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Instance running successfully.
Oct 26 16:09:38 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:09:38 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7906MB free_disk=24.956401824951172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Failed to set time: agent not configured {{(pid=74646) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-8302fd07-afa9-4a5c-bcba-fdd27a888c52 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] finish_migration finished successfully. {{(pid=74646) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Applying migration context for instance 9e46d857-97e1-40a0-9232-57438a82f8c6 as it has an incoming, in-progress migration 00c116ee-9516-4212-b9a7-47bf8468bc3f. Migration status is post-migrating {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 16:09:38 user nova-compute[74646]: INFO nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updating resource usage from migration 00c116ee-9516-4212-b9a7-47bf8468bc3f
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9afc1e60-016b-4505-a123-8ec2f4311d84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 670508e6-ee5a-4aa9-bb9a-a696205174b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b4286998-93f6-439c-9c4e-b710d121420b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 511f84be-7779-4856-8611-9171c1b59d58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 0c285c4b-4895-424b-867d-af1fd8e6d151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 92c76eb3-f5d6-4233-97d3-55f0a944f798 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Migration 00c116ee-9516-4212-b9a7-47bf8468bc3f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9e46d857-97e1-40a0-9232-57438a82f8c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing inventories for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Updating ProviderTree inventory for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Updating inventory in ProviderTree for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing aggregate associations for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6, aggregates: None {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 16:09:38 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing trait associations for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 16:09:39 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:09:39 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:09:39 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:09:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.679s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:39 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:09:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "0c285c4b-4895-424b-867d-af1fd8e6d151" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:39 user nova-compute[74646]: DEBUG nova.objects.instance [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lazy-loading 'flavor' on Instance uuid 0c285c4b-4895-424b-867d-af1fd8e6d151 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:09:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "0c285c4b-4895-424b-867d-af1fd8e6d151" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:39 user nova-compute[74646]: INFO nova.compute.manager [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Attaching volume a0948c58-d078-40b1-a0c9-e5e68373572f to /dev/vdb
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.utils [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[328c4875-f98b-4f81-aff5-bfa1a51e42f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edc206e-f12d-4697-abdf-ef083edade98]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fca020-bfcf-4e9b-bf7a-947b0c8b08fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2556451e-d78a-40b6-ac16-267237d78d4a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:09:40 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe7bf28-e6f6-4523-ae4f-b34d8c90386b]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.utils [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Updating existing volume attachment record: 439bb1f0-1cad-4af8-871d-efa2783e9357 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:09:40 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9afc1e60-016b-4505-a123-8ec2f4311d84 is timed out.
Oct 26 16:09:40 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Successfully detached device vdb from instance 9afc1e60-016b-4505-a123-8ec2f4311d84 from the live domain config.
Oct 26 16:09:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CqRwDLfK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:09:40 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00d068d-e058-488d-9df3-52b905919507]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:09:40 user nova-compute[74646]: No targets found.
Oct 26 16:09:40 user nova-compute[74646]: iSNS:
Oct 26 16:09:40 user nova-compute[74646]: No targets found.
Oct 26 16:09:40 user nova-compute[74646]: STATIC:
Oct 26 16:09:40 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827
Oct 26 16:09:40 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:40 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:40 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126
Oct 26 16:09:40 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:40 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:40 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:09:40 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:40 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:40 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f
Oct 26 16:09:40 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:40 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:40 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b
Oct 26 16:09:40 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:40 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:40 user nova-compute[74646]: FIRMWARE:
Oct 26 16:09:40 user nova-compute[74646]: No targets found.
Oct 26 16:09:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:09:40 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:09:40 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ea8fca-a6e2-438e-8061-762def308688]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7656dcc3-882e-412b-8fb3-87a474728b33]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:09:40 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:09:40 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:09:40 user nova-compute[74646]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)
Oct 26 16:09:40 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:09:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:09:40 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:09:40 user nova-compute[74646]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f (non-flash)
Oct 26 16:09:40 user nova-compute[74646]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)
Oct 26 16:09:40 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:09:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d04f40d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f'): ({'sdd'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Removing single pathed devices sdd {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e490eb1-50b9-4337-9fee-ed2cbcc0c481]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92a1eb7-52dd-4f8c-8125-054abaa24025]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Flushing IO for device /dev/sdd {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b802763-3255-4bfc-bbc2-40920722781f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ddd3afd-2d14-40b9-9872-99ea3b7528d8]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f8e991-7057-477d-8ae8-9b89bfb90235]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f766bca9-ed1e-4128-af6c-dc1a1ce483d6]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f, portal: 172.16.0.220,3260]
Oct 26 16:09:40 user nova-compute[74646]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f, portal: 172.16.0.220,3260] successful.
Oct 26 16:09:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1cfd75c6-3608-484e-ab17-71d7a115015f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd469141-8bfb-40e2-9a29-ab7fc6687c51]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] <== disconnect_volume: return (328ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:09:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:41 user nova-compute[74646]: INFO nova.compute.manager [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Terminating instance
Oct 26 16:09:41 user nova-compute[74646]: DEBUG nova.compute.manager [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG nova.compute.manager [req-9cf6490d-a805-416c-b05e-ad9aa47ad1a1 req-c7a7cebe-978d-4704-8fba-49fa6dcf3450 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-vif-unplugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9cf6490d-a805-416c-b05e-ad9aa47ad1a1 req-c7a7cebe-978d-4704-8fba-49fa6dcf3450 service nova] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9cf6490d-a805-416c-b05e-ad9aa47ad1a1 req-c7a7cebe-978d-4704-8fba-49fa6dcf3450 service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9cf6490d-a805-416c-b05e-ad9aa47ad1a1 req-c7a7cebe-978d-4704-8fba-49fa6dcf3450 service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG nova.compute.manager [req-9cf6490d-a805-416c-b05e-ad9aa47ad1a1 req-c7a7cebe-978d-4704-8fba-49fa6dcf3450 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] No waiting events found dispatching network-vif-unplugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG nova.compute.manager [req-9cf6490d-a805-416c-b05e-ad9aa47ad1a1 req-c7a7cebe-978d-4704-8fba-49fa6dcf3450 service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-vif-unplugged-54ef776d-25f3-4729-98c1-6ecc9029e55e for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG nova.objects.instance [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lazy-loading 'flavor' on Instance uuid 9afc1e60-016b-4505-a123-8ec2f4311d84 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:09:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-61520b93-46aa-4c08-96c6-288dfa673d01 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.972s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:42 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Instance destroyed successfully.
Oct 26 16:09:42 user nova-compute[74646]: DEBUG nova.objects.instance [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lazy-loading 'resources' on Instance uuid 670508e6-ee5a-4aa9-bb9a-a696205174b8 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:04:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-163721245',display_name='tempest-TestMinimumBasicScenario-server-163721245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-163721245',id=29,image_ref='dce153f2-3afa-4add-885e-d08e1a98449b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOD42axiQ6vuzg5vRgqQbfl7+rAMqHHcy8T+PuWjPAWv+N3NUiZBzREMB3lqxHQu6SmLTnm0f2W6skdla2Cme+AFtQpPdVm0qeCCk9Yg6xPTI2c8dsYU12YIrUzMvSlkeA==',key_name='tempest-TestMinimumBasicScenario-217858511',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:04:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0e982f0135534a22ba32bb089b85d3f3',ramdisk_id='',reservation_id='r-nynz53ds',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='dce153f2-3afa-4add-885e-d08e1a98449b',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1275819184',owner_user_name='tempest-TestMinimumBasicScenario-1275819184-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:06:56Z,user_data=None,user_id='e00e398f6dc344f4afaa44c119f87f2b',uuid=670508e6-ee5a-4aa9-bb9a-a696205174b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Converting VIF {"id": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "address": "fa:16:3e:bf:55:01", "network": {"id": "771871f2-36c1-4cc5-aa99-b2687f67b96c", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-124767980-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0e982f0135534a22ba32bb089b85d3f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap54ef776d-25", "ovs_interfaceid": "54ef776d-25f3-4729-98c1-6ecc9029e55e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:55:01,bridge_name='br-int',has_traffic_filtering=True,id=54ef776d-25f3-4729-98c1-6ecc9029e55e,network=Network(771871f2-36c1-4cc5-aa99-b2687f67b96c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ef776d-25') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG os_vif [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:55:01,bridge_name='br-int',has_traffic_filtering=True,id=54ef776d-25f3-4729-98c1-6ecc9029e55e,network=Network(771871f2-36c1-4cc5-aa99-b2687f67b96c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ef776d-25') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap54ef776d-25, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e621bbc-a18b-49e8-9808-9f8c171f39a3) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:09:42 user nova-compute[74646]: INFO os_vif [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:55:01,bridge_name='br-int',has_traffic_filtering=True,id=54ef776d-25f3-4729-98c1-6ecc9029e55e,network=Network(771871f2-36c1-4cc5-aa99-b2687f67b96c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap54ef776d-25')
Oct 26 16:09:42 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Deleting instance files /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8_del
Oct 26 16:09:42 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Deletion of /opt/stack/data/nova/instances/670508e6-ee5a-4aa9-bb9a-a696205174b8_del complete
Oct 26 16:09:42 user nova-compute[74646]: INFO nova.compute.manager [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 26 16:09:42 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:09:42 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Took 0.53 seconds to deallocate network for instance.
Oct 26 16:09:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:43 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:09:43 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:09:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:43 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Deleted allocations for instance 670508e6-ee5a-4aa9-bb9a-a696205174b8
Oct 26 16:09:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-081e5a94-565b-4c6c-80e5-5d741a3e59c1 tempest-TestMinimumBasicScenario-1275819184 tempest-TestMinimumBasicScenario-1275819184-project-member] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.085s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:44 user nova-compute[74646]: DEBUG nova.compute.manager [req-e419469a-7191-4b03-9e93-5b4dff720951 req-973dd5dd-f0a2-4cde-80e3-cbd7df0d89da service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:09:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e419469a-7191-4b03-9e93-5b4dff720951 req-973dd5dd-f0a2-4cde-80e3-cbd7df0d89da service nova] Acquiring lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e419469a-7191-4b03-9e93-5b4dff720951 req-973dd5dd-f0a2-4cde-80e3-cbd7df0d89da service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e419469a-7191-4b03-9e93-5b4dff720951 req-973dd5dd-f0a2-4cde-80e3-cbd7df0d89da service nova] Lock "670508e6-ee5a-4aa9-bb9a-a696205174b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:44 user nova-compute[74646]: DEBUG nova.compute.manager [req-e419469a-7191-4b03-9e93-5b4dff720951 req-973dd5dd-f0a2-4cde-80e3-cbd7df0d89da service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] No waiting events found dispatching network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:09:44 user nova-compute[74646]: WARNING nova.compute.manager [req-e419469a-7191-4b03-9e93-5b4dff720951 req-973dd5dd-f0a2-4cde-80e3-cbd7df0d89da service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received unexpected event network-vif-plugged-54ef776d-25f3-4729-98c1-6ecc9029e55e for instance with vm_state deleted and task_state None.
Oct 26 16:09:44 user nova-compute[74646]: DEBUG nova.compute.manager [req-e419469a-7191-4b03-9e93-5b4dff720951 req-973dd5dd-f0a2-4cde-80e3-cbd7df0d89da service nova] [instance: 670508e6-ee5a-4aa9-bb9a-a696205174b8] Received event network-vif-deleted-54ef776d-25f3-4729-98c1-6ecc9029e55e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:09:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:47 user nova-compute[74646]: DEBUG nova.compute.manager [req-b8d47c61-583b-484a-b9aa-d8e9765525f5 req-2aa7dd3d-32be-4b09-aa05-68e2f541346a service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Received event network-changed-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:09:47 user nova-compute[74646]: DEBUG nova.compute.manager [req-b8d47c61-583b-484a-b9aa-d8e9765525f5 req-2aa7dd3d-32be-4b09-aa05-68e2f541346a service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Refreshing instance network info cache due to event network-changed-2aae00e0-f06a-495d-a4f8-90dadf9d67e8. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:09:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b8d47c61-583b-484a-b9aa-d8e9765525f5 req-2aa7dd3d-32be-4b09-aa05-68e2f541346a service nova] Acquiring lock "refresh_cache-92c76eb3-f5d6-4233-97d3-55f0a944f798" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:09:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b8d47c61-583b-484a-b9aa-d8e9765525f5 req-2aa7dd3d-32be-4b09-aa05-68e2f541346a service nova] Acquired lock "refresh_cache-92c76eb3-f5d6-4233-97d3-55f0a944f798" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:09:47 user nova-compute[74646]: DEBUG nova.network.neutron [req-b8d47c61-583b-484a-b9aa-d8e9765525f5 req-2aa7dd3d-32be-4b09-aa05-68e2f541346a service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Refreshing network info cache for port 2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG nova.network.neutron [req-b8d47c61-583b-484a-b9aa-d8e9765525f5 req-2aa7dd3d-32be-4b09-aa05-68e2f541346a service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Updated VIF entry in instance network info cache for port 2aae00e0-f06a-495d-a4f8-90dadf9d67e8. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG nova.network.neutron [req-b8d47c61-583b-484a-b9aa-d8e9765525f5 req-2aa7dd3d-32be-4b09-aa05-68e2f541346a service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Updating instance_info_cache with network_info: [{"id": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "address": "fa:16:3e:12:fd:2d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aae00e0-f0", "ovs_interfaceid": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b8d47c61-583b-484a-b9aa-d8e9765525f5 req-2aa7dd3d-32be-4b09-aa05-68e2f541346a service nova] Releasing lock "refresh_cache-92c76eb3-f5d6-4233-97d3-55f0a944f798" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "92c76eb3-f5d6-4233-97d3-55f0a944f798" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "92c76eb3-f5d6-4233-97d3-55f0a944f798" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:48 user nova-compute[74646]: INFO nova.compute.manager [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Terminating instance
Oct 26 16:09:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-16acfe55-b610-4745-b271-483dc0a1ada6 req-df1e760f-3fbd-43e5-95b1-6d34b3c58c75 service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Received event network-vif-unplugged-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-16acfe55-b610-4745-b271-483dc0a1ada6 req-df1e760f-3fbd-43e5-95b1-6d34b3c58c75 service nova] Acquiring lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-16acfe55-b610-4745-b271-483dc0a1ada6 req-df1e760f-3fbd-43e5-95b1-6d34b3c58c75 service nova] Lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-16acfe55-b610-4745-b271-483dc0a1ada6 req-df1e760f-3fbd-43e5-95b1-6d34b3c58c75 service nova] Lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-16acfe55-b610-4745-b271-483dc0a1ada6 req-df1e760f-3fbd-43e5-95b1-6d34b3c58c75 service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] No waiting events found dispatching network-vif-unplugged-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-16acfe55-b610-4745-b271-483dc0a1ada6 req-df1e760f-3fbd-43e5-95b1-6d34b3c58c75 service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Received event network-vif-unplugged-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:49 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Instance destroyed successfully.
Oct 26 16:09:49 user nova-compute[74646]: DEBUG nova.objects.instance [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lazy-loading 'resources' on Instance uuid 92c76eb3-f5d6-4233-97d3-55f0a944f798 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1908508336',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1908508336',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1908508336',id=34,image_ref='c8b41abc-741f-4623-9769-344ad4144248',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6GwjqD8y+u9e5jTSxX3jinGmEKIzgy3cBB2jOyGfipVaZBGEU4mGV8lCjoFcBdNIkuRQ7zJY5tYHxwDcZIWyfSiK7lmRUv83X0c3I2hSsfMKcf1LpPoDBCw+VzCapjeQ==',key_name='tempest-keypair-185895398',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:08:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-4665p37x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1231840017',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:08:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9419f9603ca647269ed1cf42e233507f',uuid=92c76eb3-f5d6-4233-97d3-55f0a944f798,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "address": "fa:16:3e:12:fd:2d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aae00e0-f0", "ovs_interfaceid": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "address": "fa:16:3e:12:fd:2d", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2aae00e0-f0", "ovs_interfaceid": "2aae00e0-f06a-495d-a4f8-90dadf9d67e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:12:fd:2d,bridge_name='br-int',has_traffic_filtering=True,id=2aae00e0-f06a-495d-a4f8-90dadf9d67e8,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aae00e0-f0') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_vif [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:fd:2d,bridge_name='br-int',has_traffic_filtering=True,id=2aae00e0-f06a-495d-a4f8-90dadf9d67e8,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aae00e0-f0') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2aae00e0-f0, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=278df59b-c054-4da8-bbd6-486b43eee5d5) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:09:49 user nova-compute[74646]: INFO os_vif [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:12:fd:2d,bridge_name='br-int',has_traffic_filtering=True,id=2aae00e0-f06a-495d-a4f8-90dadf9d67e8,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2aae00e0-f0')
Oct 26 16:09:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'coRGeKJD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:09:49 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9564ade8-fef7-47f5-a563-d11809f5a46b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:09:49 user nova-compute[74646]: No targets found.
Oct 26 16:09:49 user nova-compute[74646]: iSNS:
Oct 26 16:09:49 user nova-compute[74646]: No targets found.
Oct 26 16:09:49 user nova-compute[74646]: STATIC:
Oct 26 16:09:49 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827
Oct 26 16:09:49 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:49 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:49 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126
Oct 26 16:09:49 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:49 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:49 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:09:49 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:49 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:49 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b
Oct 26 16:09:49 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:09:49 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:09:49 user nova-compute[74646]: FIRMWARE:
Oct 26 16:09:49 user nova-compute[74646]: No targets found.
Oct 26 16:09:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:09:49 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:09:49 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1262c0c0-5f02-4572-9b2d-b1ddfeb7e735]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[624c7d7c-94bd-4961-87e0-2ae741a4646a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:09:49 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:09:49 user nova-compute[74646]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)
Oct 26 16:09:49 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:09:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:09:49 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:09:49 user nova-compute[74646]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 (non-flash)
Oct 26 16:09:49 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:09:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d05b3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827'): ({'sdg'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Removing single pathed devices sdg {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[57617d69-8905-4d77-8f04-44d6fbc47b17]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6890b866-6c93-48e5-8b37-ffedd3600965]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flushing IO for device /dev/sdg {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee930d72-2d05-4a41-bedd-9f66bdbcea70]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.048s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c2658b-9e90-47de-b9ee-63d0a7950786]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] SCSI volumes sdg have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.200s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d3e754-59d1-41b9-bbcd-2357bafe9b64]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a0bc88-9d40-49c8-be11-b7a3e5e91152]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827, portal: 172.16.0.220,3260]
Oct 26 16:09:49 user nova-compute[74646]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827, portal: 172.16.0.220,3260] successful.
Oct 26 16:09:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7979d2f4-2805-4731-93ea-16010a980827 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4867ec9c-83f5-4064-827c-6397bad232e4]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.507s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== disconnect_volume: return (509ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:09:49 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Deleting instance files /opt/stack/data/nova/instances/92c76eb3-f5d6-4233-97d3-55f0a944f798_del
Oct 26 16:09:49 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Deletion of /opt/stack/data/nova/instances/92c76eb3-f5d6-4233-97d3-55f0a944f798_del complete
Oct 26 16:09:49 user nova-compute[74646]: INFO nova.compute.manager [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Took 1.43 seconds to destroy the instance on the hypervisor.
Oct 26 16:09:49 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:09:49 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:09:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:50 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:09:50 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Took 0.82 seconds to deallocate network for instance.
Oct 26 16:09:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-6522e811-584a-43d5-8982-f1d0161ee04d req-f8ecf9a9-5be0-4a3d-aa76-b5f5ab3f0cda service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Received event network-vif-deleted-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:09:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-3ce3763c-4317-4559-acc0-32f3fcc9ad4c req-0af3b5d5-fff6-4757-89e8-c1abac3c7e95 service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Received event network-vif-plugged-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:09:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3ce3763c-4317-4559-acc0-32f3fcc9ad4c req-0af3b5d5-fff6-4757-89e8-c1abac3c7e95 service nova] Acquiring lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3ce3763c-4317-4559-acc0-32f3fcc9ad4c req-0af3b5d5-fff6-4757-89e8-c1abac3c7e95 service nova] Lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3ce3763c-4317-4559-acc0-32f3fcc9ad4c req-0af3b5d5-fff6-4757-89e8-c1abac3c7e95 service nova] Lock "92c76eb3-f5d6-4233-97d3-55f0a944f798-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-3ce3763c-4317-4559-acc0-32f3fcc9ad4c req-0af3b5d5-fff6-4757-89e8-c1abac3c7e95 service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] No waiting events found dispatching network-vif-plugged-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:09:50 user nova-compute[74646]: WARNING nova.compute.manager [req-3ce3763c-4317-4559-acc0-32f3fcc9ad4c req-0af3b5d5-fff6-4757-89e8-c1abac3c7e95 service nova] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Received unexpected event network-vif-plugged-2aae00e0-f06a-495d-a4f8-90dadf9d67e8 for instance with vm_state active and task_state deleting.
Oct 26 16:09:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:51 user nova-compute[74646]: INFO nova.compute.manager [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Took 0.97 seconds to detach 1 volumes for instance.
Oct 26 16:09:51 user nova-compute[74646]: DEBUG nova.compute.manager [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 92c76eb3-f5d6-4233-97d3-55f0a944f798] Deleting volume: 7979d2f4-2805-4731-93ea-16010a980827 {{(pid=74646) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 16:09:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:09:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:09:52 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:09:52 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:09:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.539s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:52 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Deleted allocations for instance 92c76eb3-f5d6-4233-97d3-55f0a944f798
Oct 26 16:09:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-2533d050-88d2-42a3-9ba1-0cbb4ffe6a90 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "92c76eb3-f5d6-4233-97d3-55f0a944f798" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.093s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:09:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:09:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvyJibNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:10:00 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:10:00 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:10:00 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[70df7e8e-a7d1-4c26-814f-906cee1f1ddf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:10:00 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4a729b-d22d-4e71-a9da-ec4d3f63b89b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f] added
Oct 26 16:10:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e98e19-244f-4830-874f-2124f7772d6f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a58e26-baca-4cf3-9667-59b52e23620f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XvyJibNI {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XvyJibNI" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcc9b7d-2c83-40e9-b472-065af0de2e0b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XvyJibNI'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[943b6cd2-ea1a-49fa-ba26-aa9977e92e24]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[66dd9501-d22d-4cb5-97e8-03d29724719f]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:10:00 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:10:00 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:10:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:10:00 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:10:00 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:10:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7143e699-d64d-4780-9d43-4527b3995620]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f, portal: 172.16.0.220,3260]
Oct 26 16:10:00 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f, portal: 172.16.0.220,3260] successful.
Oct 26 16:10:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[942247a1-3e3c-4223-8aaa-a65bf50d4c15]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4616f13-cc6e-4628-9cb0-4f3704897763]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:10:00 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:10:00 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:10:00 user nova-compute[74646]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f (non-flash)
Oct 26 16:10:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:10:00 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:10:00 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:10:00 user nova-compute[74646]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f (non-flash)
Oct 26 16:10:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[958c926f-c6cc-43c0-b012-ecd7377bb6f6]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:10:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvyJibNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:10:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:10:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26435376232383366', 'path': '/dev/sdd'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:10:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435376232383366', 'path': '/dev/sdd'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:10:01 user nova-compute[74646]: DEBUG nova.objects.instance [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lazy-loading 'flavor' on Instance uuid 0c285c4b-4895-424b-867d-af1fd8e6d151 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:10:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:10:01 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:10:01 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:10:01 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:10:01 user nova-compute[74646]:   <serial>a0948c58-d078-40b1-a0c9-e5e68373572f</serial>
Oct 26 16:10:01 user nova-compute[74646]: </disk>
Oct 26 16:10:01 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:10:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:10:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:10:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] No VIF found with MAC fa:16:3e:9a:e9:aa, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:10:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-666527e2-79eb-491f-b5bb-da0348c3bd58 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.970s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "0c285c4b-4895-424b-867d-af1fd8e6d151" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:04 user nova-compute[74646]: INFO nova.compute.manager [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Detaching volume a0948c58-d078-40b1-a0c9-e5e68373572f
Oct 26 16:10:04 user nova-compute[74646]: INFO nova.virt.block_device [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Attempting to driver detach volume a0948c58-d078-40b1-a0c9-e5e68373572f from mountpoint /dev/vdb
Oct 26 16:10:04 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Attempting to detach device vdb from instance 0c285c4b-4895-424b-867d-af1fd8e6d151 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:10:04 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:10:04 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:10:04 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:10:04 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:10:04 user nova-compute[74646]:   <serial>a0948c58-d078-40b1-a0c9-e5e68373572f</serial>
Oct 26 16:10:04 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:10:04 user nova-compute[74646]: </disk>
Oct 26 16:10:04 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:10:04 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Successfully detached device vdb from instance 0c285c4b-4895-424b-867d-af1fd8e6d151 from the persistent domain config.
Oct 26 16:10:04 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0c285c4b-4895-424b-867d-af1fd8e6d151 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:10:04 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:10:04 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:10:04 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:10:04 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:10:04 user nova-compute[74646]:   <serial>a0948c58-d078-40b1-a0c9-e5e68373572f</serial>
Oct 26 16:10:04 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:10:04 user nova-compute[74646]: </disk>
Oct 26 16:10:04 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:10:04 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0c285c4b-4895-424b-867d-af1fd8e6d151 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:10:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:10 user nova-compute[74646]: INFO nova.compute.manager [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Terminating instance
Oct 26 16:10:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-aa75b740-0bf0-453b-aae2-8b50e9e93977 req-ca272e00-c9ac-45d6-8b3c-7e57da6b7657 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-vif-unplugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aa75b740-0bf0-453b-aae2-8b50e9e93977 req-ca272e00-c9ac-45d6-8b3c-7e57da6b7657 service nova] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aa75b740-0bf0-453b-aae2-8b50e9e93977 req-ca272e00-c9ac-45d6-8b3c-7e57da6b7657 service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-aa75b740-0bf0-453b-aae2-8b50e9e93977 req-ca272e00-c9ac-45d6-8b3c-7e57da6b7657 service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-aa75b740-0bf0-453b-aae2-8b50e9e93977 req-ca272e00-c9ac-45d6-8b3c-7e57da6b7657 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] No waiting events found dispatching network-vif-unplugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:10:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-aa75b740-0bf0-453b-aae2-8b50e9e93977 req-ca272e00-c9ac-45d6-8b3c-7e57da6b7657 service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-vif-unplugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:11 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Instance destroyed successfully.
Oct 26 16:10:11 user nova-compute[74646]: DEBUG nova.objects.instance [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lazy-loading 'resources' on Instance uuid 9afc1e60-016b-4505-a123-8ec2f4311d84 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:02:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1818110104',display_name='tempest-ServerStableDeviceRescueTest-server-1818110104',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1818110104',id=28,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAsDVhutifjQH2fs3DJ9owCuxkPwhwBPKRt1WQ/uin9Ku9P4syVZ+tiG3bU+0TOwcMRKMrI6BoQrpoCH9bZ+c7DabwfLKDBwpYQV5HRbOJ2LXumMCWgL0Z33FIh6FgHCug==',key_name='tempest-keypair-1985130805',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:07:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ec5750bffd274d89bc32c0aea139061c',ramdisk_id='',reservation_id='r-ogxyw4vr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-399818180',owner_user_name='tempest-ServerStableDeviceRescueTest-399818180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:08:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f53e1b1d3d84c48b1ea84480b83aa71',uuid=9afc1e60-016b-4505-a123-8ec2f4311d84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Converting VIF {"id": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "address": "fa:16:3e:d3:2a:b2", "network": {"id": "7cf97893-1b8b-4791-8477-53c16f8923a5", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-2037416426-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ec5750bffd274d89bc32c0aea139061c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ac5e586-1f", "ovs_interfaceid": "6ac5e586-1f3c-4057-8e24-73a8d6de614a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:2a:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ac5e586-1f3c-4057-8e24-73a8d6de614a,network=Network(7cf97893-1b8b-4791-8477-53c16f8923a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac5e586-1f') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG os_vif [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:2a:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ac5e586-1f3c-4057-8e24-73a8d6de614a,network=Network(7cf97893-1b8b-4791-8477-53c16f8923a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac5e586-1f') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ac5e586-1f, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fcee5dac-1e71-4b5d-b162-e9630868dab5) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:11 user nova-compute[74646]: INFO os_vif [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:2a:b2,bridge_name='br-int',has_traffic_filtering=True,id=6ac5e586-1f3c-4057-8e24-73a8d6de614a,network=Network(7cf97893-1b8b-4791-8477-53c16f8923a5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ac5e586-1f')
Oct 26 16:10:11 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Deleting instance files /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84_del
Oct 26 16:10:11 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Deletion of /opt/stack/data/nova/instances/9afc1e60-016b-4505-a123-8ec2f4311d84_del complete
Oct 26 16:10:11 user nova-compute[74646]: INFO nova.compute.manager [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 26 16:10:11 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:10:11 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:10:12 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:10:12 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Took 0.79 seconds to deallocate network for instance.
Oct 26 16:10:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:12 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:10:12 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:10:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:12 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Deleted allocations for instance 9afc1e60-016b-4505-a123-8ec2f4311d84
Oct 26 16:10:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-500bb32d-905e-400a-bab4-0373a9f9ff83 tempest-ServerStableDeviceRescueTest-399818180 tempest-ServerStableDeviceRescueTest-399818180-project-member] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.130s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-fe0aad29-4a63-495e-8779-da8d1491d7be req-e0ad5946-01c7-476e-9600-414d016ed74f service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:10:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fe0aad29-4a63-495e-8779-da8d1491d7be req-e0ad5946-01c7-476e-9600-414d016ed74f service nova] Acquiring lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fe0aad29-4a63-495e-8779-da8d1491d7be req-e0ad5946-01c7-476e-9600-414d016ed74f service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fe0aad29-4a63-495e-8779-da8d1491d7be req-e0ad5946-01c7-476e-9600-414d016ed74f service nova] Lock "9afc1e60-016b-4505-a123-8ec2f4311d84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-fe0aad29-4a63-495e-8779-da8d1491d7be req-e0ad5946-01c7-476e-9600-414d016ed74f service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] No waiting events found dispatching network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:10:12 user nova-compute[74646]: WARNING nova.compute.manager [req-fe0aad29-4a63-495e-8779-da8d1491d7be req-e0ad5946-01c7-476e-9600-414d016ed74f service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received unexpected event network-vif-plugged-6ac5e586-1f3c-4057-8e24-73a8d6de614a for instance with vm_state deleted and task_state None.
Oct 26 16:10:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-fe0aad29-4a63-495e-8779-da8d1491d7be req-e0ad5946-01c7-476e-9600-414d016ed74f service nova] [instance: 9afc1e60-016b-4505-a123-8ec2f4311d84] Received event network-vif-deleted-6ac5e586-1f3c-4057-8e24-73a8d6de614a {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:10:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:24 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0c285c4b-4895-424b-867d-af1fd8e6d151 is timed out.
Oct 26 16:10:24 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Successfully detached device vdb from instance 0c285c4b-4895-424b-867d-af1fd8e6d151 from the live domain config.
Oct 26 16:10:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XvyJibNI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:10:24 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3b52b8-354d-4387-b3b1-5e8a4a1c29f2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:10:24 user nova-compute[74646]: No targets found.
Oct 26 16:10:24 user nova-compute[74646]: iSNS:
Oct 26 16:10:24 user nova-compute[74646]: No targets found.
Oct 26 16:10:24 user nova-compute[74646]: STATIC:
Oct 26 16:10:24 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f
Oct 26 16:10:24 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:10:24 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:10:24 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126
Oct 26 16:10:24 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:10:24 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:10:24 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:10:24 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:10:24 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:10:24 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b
Oct 26 16:10:24 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:10:24 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:10:24 user nova-compute[74646]: FIRMWARE:
Oct 26 16:10:24 user nova-compute[74646]: No targets found.
Oct 26 16:10:24 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:10:24 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:10:24 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ebe6c2-d0d3-45a0-b8df-38c60f7ffb66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[730ab072-52b0-47a4-8158-19cebd135a4d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:10:24 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:10:24 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:10:24 user nova-compute[74646]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f (non-flash)
Oct 26 16:10:24 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:10:24 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:10:24 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:10:24 user nova-compute[74646]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f (non-flash)
Oct 26 16:10:24 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d0475090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f'): ({'sdd'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Removing single pathed devices sdd {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ed6726-389c-485e-9648-fb994906da60]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5239434-b780-47e1-b569-4f3d6775c8bb]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Flushing IO for device /dev/sdd {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabcf2a8-661e-47f5-a832-90a5984e1430]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5b45a1-792b-43db-9dad-866383af5165]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6437fe-3269-442a-a0ba-2bb9132193e7]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:10:24 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:25 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[996a97ae-1872-4b75-9f4c-6e1471404556]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:25 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f, portal: 172.16.0.220,3260]
Oct 26 16:10:25 user nova-compute[74646]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f, portal: 172.16.0.220,3260] successful.
Oct 26 16:10:25 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:10:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0948c58-d078-40b1-a0c9-e5e68373572f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:25 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0c76a8-7659-4ad5-9ad3-191683b32842]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:25 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:10:25 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:10:25 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] <== disconnect_volume: return (294ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:10:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:10:25 user nova-compute[74646]: DEBUG nova.objects.instance [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lazy-loading 'flavor' on Instance uuid 0c285c4b-4895-424b-867d-af1fd8e6d151 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:10:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-3ee2f65c-8f8c-4fe0-bb1d-ec13a0b8ab7a tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.745s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:28 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:10:29 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:10:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:32 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:10:32 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:10:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:10:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:10:32 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:10:32 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Updating instance_info_cache with network_info: [{"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:10:32 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:10:32 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:10:32 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:10:32 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:10:32 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:10:33 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:10:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:33 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:10:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:10:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:10:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:10:33 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:34 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "f70f8714-4267-481f-bf97-e0afe03668a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:35 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:10:35 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8174MB free_disk=25.195465087890625GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Applying migration context for instance 9e46d857-97e1-40a0-9232-57438a82f8c6 as it has an incoming, in-progress migration 00c116ee-9516-4212-b9a7-47bf8468bc3f. Migration status is finished {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 26 16:10:35 user nova-compute[74646]: INFO nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updating resource usage from migration 00c116ee-9516-4212-b9a7-47bf8468bc3f
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance b4286998-93f6-439c-9c4e-b710d121420b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 511f84be-7779-4856-8611-9171c1b59d58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 0c285c4b-4895-424b-867d-af1fd8e6d151 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Migration 00c116ee-9516-4212-b9a7-47bf8468bc3f is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9e46d857-97e1-40a0-9232-57438a82f8c6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance f70f8714-4267-481f-bf97-e0afe03668a9 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.452s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.434s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:36 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:10:36 user nova-compute[74646]: INFO nova.compute.claims [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Claim successful on node user
Oct 26 16:10:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:36 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:10:36 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:10:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:36 user nova-compute[74646]: DEBUG nova.compute.manager [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:10:36 user nova-compute[74646]: DEBUG nova.compute.manager [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:10:36 user nova-compute[74646]: DEBUG nova.network.neutron [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:10:36 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:10:36 user nova-compute[74646]: DEBUG nova.compute.manager [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:10:36 user nova-compute[74646]: INFO nova.virt.block_device [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Booting with volume-backed-image 82af3b5f-8d68-4fc0-b4be-1ea2303721ff at /dev/vda
Oct 26 16:10:36 user nova-compute[74646]: DEBUG nova.policy [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'abd7a869c235467ca4da99867c6bc0d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90e848952345455183c15fee816b6f12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:10:37 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:10:37 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:10:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:37 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:10:37 user nova-compute[74646]: DEBUG nova.network.neutron [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Successfully created port: d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:10:38 user nova-compute[74646]: DEBUG nova.network.neutron [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Successfully updated port: d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:10:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "refresh_cache-f70f8714-4267-481f-bf97-e0afe03668a9" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:10:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquired lock "refresh_cache-f70f8714-4267-481f-bf97-e0afe03668a9" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:10:38 user nova-compute[74646]: DEBUG nova.network.neutron [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:10:38 user nova-compute[74646]: DEBUG nova.compute.manager [req-ab5ebafa-30c8-463a-876f-c05d09448759 req-caa31703-551d-4868-9b95-8c008fd89945 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-changed-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:10:38 user nova-compute[74646]: DEBUG nova.compute.manager [req-ab5ebafa-30c8-463a-876f-c05d09448759 req-caa31703-551d-4868-9b95-8c008fd89945 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Refreshing instance network info cache due to event network-changed-d4171750-840e-4ebb-b99a-262d03c7e7a2. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:10:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ab5ebafa-30c8-463a-876f-c05d09448759 req-caa31703-551d-4868-9b95-8c008fd89945 service nova] Acquiring lock "refresh_cache-f70f8714-4267-481f-bf97-e0afe03668a9" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:10:38 user nova-compute[74646]: DEBUG nova.network.neutron [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:10:38 user nova-compute[74646]: DEBUG nova.network.neutron [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Updating instance_info_cache with network_info: [{"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:10:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Releasing lock "refresh_cache-f70f8714-4267-481f-bf97-e0afe03668a9" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:10:38 user nova-compute[74646]: DEBUG nova.compute.manager [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Instance network_info: |[{"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:10:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ab5ebafa-30c8-463a-876f-c05d09448759 req-caa31703-551d-4868-9b95-8c008fd89945 service nova] Acquired lock "refresh_cache-f70f8714-4267-481f-bf97-e0afe03668a9" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:10:38 user nova-compute[74646]: DEBUG nova.network.neutron [req-ab5ebafa-30c8-463a-876f-c05d09448759 req-caa31703-551d-4868-9b95-8c008fd89945 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Refreshing network info cache for port d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:10:39 user nova-compute[74646]: DEBUG nova.network.neutron [req-ab5ebafa-30c8-463a-876f-c05d09448759 req-caa31703-551d-4868-9b95-8c008fd89945 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Updated VIF entry in instance network info cache for port d4171750-840e-4ebb-b99a-262d03c7e7a2. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:10:39 user nova-compute[74646]: DEBUG nova.network.neutron [req-ab5ebafa-30c8-463a-876f-c05d09448759 req-caa31703-551d-4868-9b95-8c008fd89945 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Updating instance_info_cache with network_info: [{"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:10:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ab5ebafa-30c8-463a-876f-c05d09448759 req-caa31703-551d-4868-9b95-8c008fd89945 service nova] Releasing lock "refresh_cache-f70f8714-4267-481f-bf97-e0afe03668a9" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:10:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:10:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "b4286998-93f6-439c-9c4e-b710d121420b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "b4286998-93f6-439c-9c4e-b710d121420b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "b4286998-93f6-439c-9c4e-b710d121420b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "b4286998-93f6-439c-9c4e-b710d121420b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "b4286998-93f6-439c-9c4e-b710d121420b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:49 user nova-compute[74646]: INFO nova.compute.manager [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Terminating instance
Oct 26 16:10:49 user nova-compute[74646]: DEBUG nova.compute.manager [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:10:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Instance destroyed successfully.
Oct 26 16:10:50 user nova-compute[74646]: DEBUG nova.objects.instance [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lazy-loading 'resources' on Instance uuid b4286998-93f6-439c-9c4e-b710d121420b {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:05:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1434102605',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1434102605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1434102605',id=30,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/PTaUwdDYIS9b5kLFiujpFlEW8yV+g0ZqtGCBJq/cwho7Yy0X8s3VvklYeijfExAgw7Tx2Y6WNH4BVuDQCtlpwmpXaSAuUdbVwnXH28L3+yXrdRSKQ+GUcO4+T1+Fa5Q==',key_name='tempest-keypair-1534934421',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:06:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-xq57cdli',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9419f9603ca647269ed1cf42e233507f',uuid=b4286998-93f6-439c-9c4e-b710d121420b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "address": "fa:16:3e:5c:cb:d8", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5ab62a-73", "ovs_interfaceid": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "address": "fa:16:3e:5c:cb:d8", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.37", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapff5ab62a-73", "ovs_interfaceid": "ff5ab62a-73fd-4dcc-90dd-6e5923446b97", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=ff5ab62a-73fd-4dcc-90dd-6e5923446b97,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff5ab62a-73') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_vif [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=ff5ab62a-73fd-4dcc-90dd-6e5923446b97,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff5ab62a-73') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapff5ab62a-73, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8379f544-ef58-4c3a-b3ed-9a2c8ed3bf10) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:50 user nova-compute[74646]: INFO os_vif [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:cb:d8,bridge_name='br-int',has_traffic_filtering=True,id=ff5ab62a-73fd-4dcc-90dd-6e5923446b97,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapff5ab62a-73')
Oct 26 16:10:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RwVodvCe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:10:50 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c1656c-ec21-4ea7-bd4a-608663f6ed07]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:10:50 user nova-compute[74646]: No targets found.
Oct 26 16:10:50 user nova-compute[74646]: iSNS:
Oct 26 16:10:50 user nova-compute[74646]: No targets found.
Oct 26 16:10:50 user nova-compute[74646]: STATIC:
Oct 26 16:10:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126
Oct 26 16:10:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:10:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:10:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:10:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:10:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:10:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b
Oct 26 16:10:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:10:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:10:50 user nova-compute[74646]: FIRMWARE:
Oct 26 16:10:50 user nova-compute[74646]: No targets found.
Oct 26 16:10:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:10:50 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:10:50 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6547be9e-0356-438c-8fb2-28f7cf3a68cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdde0470-05e5-4a0c-883e-b794e920834e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:10:50 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:10:50 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:10:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:10:50 user nova-compute[74646]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b (non-flash)
Oct 26 16:10:50 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:10:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d03e0b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b'): ({'sdb'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Removing single pathed devices sdb {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c118668f-5158-45bc-88a1-943e99a9cced]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f4d961-ca7a-492a-8ec2-a91ae77a863e]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flushing IO for device /dev/sdb {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba7c767-6b9d-4207-99af-b8e1e00c8d6b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d8116c-34ea-4f30-9853-c0d13ef0822a]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[09172f11-4a7e-4374-9fef-5827c7d6d195]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1098d0-f5d5-4702-a84b-985495f2e0a3]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b, portal: 172.16.0.220,3260]
Oct 26 16:10:50 user nova-compute[74646]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b, portal: 172.16.0.220,3260] successful.
Oct 26 16:10:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff999782-58f2-4b52-8f02-c4b436b3fe2a]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== disconnect_volume: return (345ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:10:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Deleting instance files /opt/stack/data/nova/instances/b4286998-93f6-439c-9c4e-b710d121420b_del
Oct 26 16:10:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Deletion of /opt/stack/data/nova/instances/b4286998-93f6-439c-9c4e-b710d121420b_del complete
Oct 26 16:10:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:50 user nova-compute[74646]: INFO nova.compute.manager [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Took 1.24 seconds to destroy the instance on the hypervisor.
Oct 26 16:10:50 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:10:50 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: b4286998-93f6-439c-9c4e-b710d121420b] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:10:51 user nova-compute[74646]: DEBUG nova.compute.manager [req-59663a0d-98e3-433c-9504-28f56696b27a req-9b9296a3-8d3d-4f4e-bfba-3e5150da0c48 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Received event network-vif-unplugged-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:10:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-59663a0d-98e3-433c-9504-28f56696b27a req-9b9296a3-8d3d-4f4e-bfba-3e5150da0c48 service nova] Acquiring lock "b4286998-93f6-439c-9c4e-b710d121420b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-59663a0d-98e3-433c-9504-28f56696b27a req-9b9296a3-8d3d-4f4e-bfba-3e5150da0c48 service nova] Lock "b4286998-93f6-439c-9c4e-b710d121420b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-59663a0d-98e3-433c-9504-28f56696b27a req-9b9296a3-8d3d-4f4e-bfba-3e5150da0c48 service nova] Lock "b4286998-93f6-439c-9c4e-b710d121420b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:51 user nova-compute[74646]: DEBUG nova.compute.manager [req-59663a0d-98e3-433c-9504-28f56696b27a req-9b9296a3-8d3d-4f4e-bfba-3e5150da0c48 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] No waiting events found dispatching network-vif-unplugged-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:10:51 user nova-compute[74646]: DEBUG nova.compute.manager [req-59663a0d-98e3-433c-9504-28f56696b27a req-9b9296a3-8d3d-4f4e-bfba-3e5150da0c48 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Received event network-vif-unplugged-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:10:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:51 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:10:51 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Took 0.95 seconds to deallocate network for instance.
Oct 26 16:10:51 user nova-compute[74646]: DEBUG nova.compute.manager [req-c6bb17a9-1432-4e32-a2a7-bcc528bf1e04 req-8cfebbba-3498-4e45-bde8-02fda8236457 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Received event network-vif-deleted-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:10:52 user nova-compute[74646]: INFO nova.compute.manager [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Took 0.96 seconds to detach 1 volumes for instance.
Oct 26 16:10:52 user nova-compute[74646]: DEBUG nova.compute.manager [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Deleting volume: 9ca9cf42-8c69-4879-a7eb-1f89a4d25c1b {{(pid=74646) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG os_brick.utils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d262ab50-bfa3-4f3f-b1e9-73fc7be11897]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c5cd5f-cbd4-4e36-897a-1062006783d7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ef665f-e006-4509-8400-e0aaa89ea6ff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[70efd974-1485-4abe-96a9-0752e69b68c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:10:52 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:10:52 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aca519-ab43-44ef-adb1-843ec9acf391]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG os_brick.utils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:10:52 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Updating existing volume attachment record: 711e061c-0d45-497f-bcc1-e76cbc343b3a {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:10:53 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:10:53 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:10:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:53 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Deleted allocations for instance b4286998-93f6-439c-9c4e-b710d121420b
Oct 26 16:10:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-78d6c247-001f-4b36-ae6e-bab1cc55bc33 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "b4286998-93f6-439c-9c4e-b710d121420b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.788s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:53 user nova-compute[74646]: DEBUG nova.compute.manager [req-0c495592-b2cb-48f2-a129-ae83c45d2b80 req-e36e5f19-4f21-4ca8-8e13-15e2b3e20827 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Received event network-vif-plugged-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:10:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0c495592-b2cb-48f2-a129-ae83c45d2b80 req-e36e5f19-4f21-4ca8-8e13-15e2b3e20827 service nova] Acquiring lock "b4286998-93f6-439c-9c4e-b710d121420b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0c495592-b2cb-48f2-a129-ae83c45d2b80 req-e36e5f19-4f21-4ca8-8e13-15e2b3e20827 service nova] Lock "b4286998-93f6-439c-9c4e-b710d121420b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0c495592-b2cb-48f2-a129-ae83c45d2b80 req-e36e5f19-4f21-4ca8-8e13-15e2b3e20827 service nova] Lock "b4286998-93f6-439c-9c4e-b710d121420b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:53 user nova-compute[74646]: DEBUG nova.compute.manager [req-0c495592-b2cb-48f2-a129-ae83c45d2b80 req-e36e5f19-4f21-4ca8-8e13-15e2b3e20827 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] No waiting events found dispatching network-vif-plugged-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:10:53 user nova-compute[74646]: WARNING nova.compute.manager [req-0c495592-b2cb-48f2-a129-ae83c45d2b80 req-e36e5f19-4f21-4ca8-8e13-15e2b3e20827 service nova] [instance: b4286998-93f6-439c-9c4e-b710d121420b] Received unexpected event network-vif-plugged-ff5ab62a-73fd-4dcc-90dd-6e5923446b97 for instance with vm_state deleted and task_state None.
Oct 26 16:10:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:10:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "9e46d857-97e1-40a0-9232-57438a82f8c6" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:58 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Going to confirm migration 2 {{(pid=74646) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 26 16:10:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:10:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquired lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:10:58 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:10:58 user nova-compute[74646]: DEBUG nova.objects.instance [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lazy-loading 'info_cache' on Instance uuid 9e46d857-97e1-40a0-9232-57438a82f8c6 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:10:59 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updating instance_info_cache with network_info: [{"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:10:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Releasing lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:10:59 user nova-compute[74646]: DEBUG nova.objects.instance [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lazy-loading 'migration_context' on Instance uuid 9e46d857-97e1-40a0-9232-57438a82f8c6 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:10:59 user nova-compute[74646]: DEBUG nova.objects.base [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Object Instance<9e46d857-97e1-40a0-9232-57438a82f8c6> lazy-loaded attributes: info_cache,migration_context {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:10:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:10:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:10:59 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:10:59 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:10:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.355s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:10:59 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Deleted allocation for migration 00c116ee-9516-4212-b9a7-47bf8468bc3f
Oct 26 16:10:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6b4de489-92e3-439a-ad63-6593ccda4cc8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.596s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "0c285c4b-4895-424b-867d-af1fd8e6d151" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:05 user nova-compute[74646]: INFO nova.compute.manager [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Terminating instance
Oct 26 16:11:05 user nova-compute[74646]: DEBUG nova.compute.manager [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-c559be5c-7188-496c-8bd6-a217658813d5 req-5749b559-0680-4ff7-af77-4732250a89d2 service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Received event network-vif-unplugged-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c559be5c-7188-496c-8bd6-a217658813d5 req-5749b559-0680-4ff7-af77-4732250a89d2 service nova] Acquiring lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c559be5c-7188-496c-8bd6-a217658813d5 req-5749b559-0680-4ff7-af77-4732250a89d2 service nova] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c559be5c-7188-496c-8bd6-a217658813d5 req-5749b559-0680-4ff7-af77-4732250a89d2 service nova] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-c559be5c-7188-496c-8bd6-a217658813d5 req-5749b559-0680-4ff7-af77-4732250a89d2 service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] No waiting events found dispatching network-vif-unplugged-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:11:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-c559be5c-7188-496c-8bd6-a217658813d5 req-5749b559-0680-4ff7-af77-4732250a89d2 service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Received event network-vif-unplugged-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:11:06 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Instance destroyed successfully.
Oct 26 16:11:06 user nova-compute[74646]: DEBUG nova.objects.instance [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lazy-loading 'resources' on Instance uuid 0c285c4b-4895-424b-867d-af1fd8e6d151 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1341164739',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1341164739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1341164',id=33,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSnM7JUOGq+/2waZUcXiokKr3uTVGBMJa9BRyC8NWG7XTkHZWv58JDAyYXv/WICiZ5qVQQPPDLngxzSVMnkgMUOppBAa6iMW4ifg3nfnlada2UVJY0KZ0MRjyC0G55h7A==',key_name='tempest-keypair-1723281814',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:07:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='16026a9a67e34ea484655daa6a1a846e',ramdisk_id='',reservation_id='r-l4d889wd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-2116619154',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:07:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c5e462c338d54529b83b12a7980228ff',uuid=0c285c4b-4895-424b-867d-af1fd8e6d151,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "address": "fa:16:3e:9a:e9:aa", "network": {"id": "5f672f1e-93ae-4952-a144-4b4e974c1ab8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1833332180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16026a9a67e34ea484655daa6a1a846e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e37abb8-60", "ovs_interfaceid": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Converting VIF {"id": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "address": "fa:16:3e:9a:e9:aa", "network": {"id": "5f672f1e-93ae-4952-a144-4b4e974c1ab8", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1833332180-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "16026a9a67e34ea484655daa6a1a846e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1e37abb8-60", "ovs_interfaceid": "1e37abb8-6088-435a-bf9c-9fd52dc2c4ab", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:e9:aa,bridge_name='br-int',has_traffic_filtering=True,id=1e37abb8-6088-435a-bf9c-9fd52dc2c4ab,network=Network(5f672f1e-93ae-4952-a144-4b4e974c1ab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e37abb8-60') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG os_vif [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:e9:aa,bridge_name='br-int',has_traffic_filtering=True,id=1e37abb8-6088-435a-bf9c-9fd52dc2c4ab,network=Network(5f672f1e-93ae-4952-a144-4b4e974c1ab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e37abb8-60') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1e37abb8-60, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2ad373d-7855-4d80-8c27-76ddd382f8ee) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:06 user nova-compute[74646]: INFO os_vif [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:e9:aa,bridge_name='br-int',has_traffic_filtering=True,id=1e37abb8-6088-435a-bf9c-9fd52dc2c4ab,network=Network(5f672f1e-93ae-4952-a144-4b4e974c1ab8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1e37abb8-60')
Oct 26 16:11:06 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Deleting instance files /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151_del
Oct 26 16:11:06 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Deletion of /opt/stack/data/nova/instances/0c285c4b-4895-424b-867d-af1fd8e6d151_del complete
Oct 26 16:11:06 user nova-compute[74646]: INFO nova.compute.manager [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 26 16:11:06 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:11:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:07 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:11:07 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Took 0.69 seconds to deallocate network for instance.
Oct 26 16:11:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:07 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:11:07 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:11:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.309s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:07 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Deleted allocations for instance 0c285c4b-4895-424b-867d-af1fd8e6d151
Oct 26 16:11:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-00f95a4a-0589-45e3-91dd-8f0304865016 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154 tempest-TestServerVolumeAttachScenarioOldVersion-2116619154-project-member] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.099s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:07 user nova-compute[74646]: DEBUG nova.compute.manager [req-f116616b-0046-412e-bc9d-d4e0ea1dd8ab req-c13799c6-609c-4bdb-bf2e-dca7eac7fc4b service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Received event network-vif-plugged-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:11:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f116616b-0046-412e-bc9d-d4e0ea1dd8ab req-c13799c6-609c-4bdb-bf2e-dca7eac7fc4b service nova] Acquiring lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f116616b-0046-412e-bc9d-d4e0ea1dd8ab req-c13799c6-609c-4bdb-bf2e-dca7eac7fc4b service nova] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f116616b-0046-412e-bc9d-d4e0ea1dd8ab req-c13799c6-609c-4bdb-bf2e-dca7eac7fc4b service nova] Lock "0c285c4b-4895-424b-867d-af1fd8e6d151-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:07 user nova-compute[74646]: DEBUG nova.compute.manager [req-f116616b-0046-412e-bc9d-d4e0ea1dd8ab req-c13799c6-609c-4bdb-bf2e-dca7eac7fc4b service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] No waiting events found dispatching network-vif-plugged-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:11:07 user nova-compute[74646]: WARNING nova.compute.manager [req-f116616b-0046-412e-bc9d-d4e0ea1dd8ab req-c13799c6-609c-4bdb-bf2e-dca7eac7fc4b service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Received unexpected event network-vif-plugged-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab for instance with vm_state deleted and task_state None.
Oct 26 16:11:07 user nova-compute[74646]: DEBUG nova.compute.manager [req-f116616b-0046-412e-bc9d-d4e0ea1dd8ab req-c13799c6-609c-4bdb-bf2e-dca7eac7fc4b service nova] [instance: 0c285c4b-4895-424b-867d-af1fd8e6d151] Received event network-vif-deleted-1e37abb8-6088-435a-bf9c-9fd52dc2c4ab {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:11:10 user nova-compute[74646]: INFO nova.compute.claims [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Claim successful on node user
Oct 26 16:11:10 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG nova.network.neutron [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:11:10 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:11:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG nova.policy [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '35ad85c745c94ba983e147c8dd2dcbc2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d6af06081e14055b3b812f706d5ef20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:11:10 user nova-compute[74646]: INFO nova.virt.block_device [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Booting with volume 55cab237-57fe-4ecb-aba7-a1827f4ecdbe at /dev/vda
Oct 26 16:11:10 user nova-compute[74646]: DEBUG os_brick.utils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbadcbff-fea7-41a7-b055-507f930efc47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:10 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d12e56d-b4fa-445f-aa16-251fd4791c16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8357e3e1-1a4a-4629-80e0-350b1c861897]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31bc564-7204-48f6-80fc-c87a5e6fd8ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:11:11 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:11:11 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ccdb0d-c3ba-482f-a513-410fc6285046]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG os_brick.utils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updating existing volume attachment record: dd0d5a7b-7f54-4f66-bb0e-6bc3724907fe {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:11 user nova-compute[74646]: DEBUG nova.network.neutron [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Successfully created port: c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.compute.manager [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:11:12 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Creating image(s)
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Ensure instance console log exists: /opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Start _get_guest_xml network_info=[{"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '711e061c-0d45-497f-bcc1-e76cbc343b3a', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upQzlafP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f70f8714-4267-481f-bf97-e0afe03668a9', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8507f31-36cd-4435-9fbf-4e2659db518e', 'serial': 'f8507f31-36cd-4435-9fbf-4e2659db518e'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:11:12 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:11:12 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upQzlafP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:11:12 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:11:12 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:11:12 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff7760c-7540-4f18-99d8-c21b540f6341]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:11:12 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[687fbb35-0caf-42dd-ac8f-e2af49d79732]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e] added
Oct 26 16:11:12 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[09891da4-a2dd-42a1-bf09-1f2602d5d4af]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[55a76b0a-3c48-4a8a-8b00-b9eb6a2417b8]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v upQzlafP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v upQzlafP" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef2a54a-1cdd-4e15-aa19-e892158d67d1]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'upQzlafP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[861ea677-43a7-488a-8707-5bce0b7eff0f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[23541b19-e5c9-4fe1-bad7-d7b7e2698355]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:11:12 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:11:12 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:11:12 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:11:12 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Successfully updated port: c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[86923ea9-810a-4334-af02-17c65648df19]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e, portal: 172.16.0.220,3260]
Oct 26 16:11:12 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e, portal: 172.16.0.220,3260] successful.
Oct 26 16:11:12 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquired lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[44444c68-d04a-4f9d-baf4-623216f1842b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-dc62781a-f1aa-4d40-b317-e8525b35942b req-cb1be727-0225-486e-81fe-6868fa017168 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-changed-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-dc62781a-f1aa-4d40-b317-e8525b35942b req-cb1be727-0225-486e-81fe-6868fa017168 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Refreshing instance network info cache due to event network-changed-c86c4c00-d0ce-47d4-94d0-bf17114750a4. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dc62781a-f1aa-4d40-b317-e8525b35942b req-cb1be727-0225-486e-81fe-6868fa017168 service nova] Acquiring lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af1e3fa-2b64-41bf-9ec6-e622466c6838]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:11:12 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:11:12 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:11:12 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:11:12 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:11:12 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:11:12 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a217d8-c2e6-4ea8-ae74-fb9af0753ba0]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: None {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.network.neutron [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updating instance_info_cache with network_info: [{"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Releasing lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.compute.manager [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Instance network_info: |[{"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dc62781a-f1aa-4d40-b317-e8525b35942b req-cb1be727-0225-486e-81fe-6868fa017168 service nova] Acquired lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:11:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-dc62781a-f1aa-4d40-b317-e8525b35942b req-cb1be727-0225-486e-81fe-6868fa017168 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Refreshing network info cache for port c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG nova.network.neutron [req-dc62781a-f1aa-4d40-b317-e8525b35942b req-cb1be727-0225-486e-81fe-6868fa017168 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updated VIF entry in instance network info cache for port c86c4c00-d0ce-47d4-94d0-bf17114750a4. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG nova.network.neutron [req-dc62781a-f1aa-4d40-b317-e8525b35942b req-cb1be727-0225-486e-81fe-6868fa017168 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updating instance_info_cache with network_info: [{"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dc62781a-f1aa-4d40-b317-e8525b35942b req-cb1be727-0225-486e-81fe-6868fa017168 service nova] Releasing lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upQzlafP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.349s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '23834323739626535', 'path': '/dev/sdb'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834323739626535', 'path': '/dev/sdb'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:10:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1368171435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1368171435',id=35,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90e848952345455183c15fee816b6f12',ramdisk_id='',reservation_id='r-fhizlcr9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-580785668',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:10:37Z,user_data=None,user_id='abd7a869c235467ca4da99867c6bc0d4',uuid=f70f8714-4267-481f-bf97-e0afe03668a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converting VIF {"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:39:0c,bridge_name='br-int',has_traffic_filtering=True,id=d4171750-840e-4ebb-b99a-262d03c7e7a2,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4171750-84') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG nova.objects.instance [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'pci_devices' on Instance uuid f70f8714-4267-481f-bf97-e0afe03668a9 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:11:13 user nova-compute[74646]:   <uuid>f70f8714-4267-481f-bf97-e0afe03668a9</uuid>
Oct 26 16:11:13 user nova-compute[74646]:   <name>instance-00000023</name>
Oct 26 16:11:13 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:11:13 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:11:13 user nova-compute[74646]:   <metadata>
Oct 26 16:11:13 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:11:13 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:11:13 user nova-compute[74646]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1368171435</nova:name>
Oct 26 16:11:13 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:11:12</nova:creationTime>
Oct 26 16:11:13 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:11:13 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:11:13 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:11:13 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:11:13 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:11:13 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:11:13 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:11:13 user nova-compute[74646]:       <nova:owner>
Oct 26 16:11:13 user nova-compute[74646]:         <nova:user uuid="abd7a869c235467ca4da99867c6bc0d4">tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member</nova:user>
Oct 26 16:11:13 user nova-compute[74646]:         <nova:project uuid="90e848952345455183c15fee816b6f12">tempest-ServerBootFromVolumeStableRescueTest-580785668</nova:project>
Oct 26 16:11:13 user nova-compute[74646]:       </nova:owner>
Oct 26 16:11:13 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:11:13 user nova-compute[74646]:       <nova:ports>
Oct 26 16:11:13 user nova-compute[74646]:         <nova:port uuid="d4171750-840e-4ebb-b99a-262d03c7e7a2">
Oct 26 16:11:13 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 16:11:13 user nova-compute[74646]:         </nova:port>
Oct 26 16:11:13 user nova-compute[74646]:       </nova:ports>
Oct 26 16:11:13 user nova-compute[74646]:     </nova:instance>
Oct 26 16:11:13 user nova-compute[74646]:   </metadata>
Oct 26 16:11:13 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:11:13 user nova-compute[74646]:     <system>
Oct 26 16:11:13 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:11:13 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:11:13 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:11:13 user nova-compute[74646]:       <entry name="serial">f70f8714-4267-481f-bf97-e0afe03668a9</entry>
Oct 26 16:11:13 user nova-compute[74646]:       <entry name="uuid">f70f8714-4267-481f-bf97-e0afe03668a9</entry>
Oct 26 16:11:13 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:11:13 user nova-compute[74646]:     </system>
Oct 26 16:11:13 user nova-compute[74646]:   </sysinfo>
Oct 26 16:11:13 user nova-compute[74646]:   <os>
Oct 26 16:11:13 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:11:13 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:11:13 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:11:13 user nova-compute[74646]:   </os>
Oct 26 16:11:13 user nova-compute[74646]:   <features>
Oct 26 16:11:13 user nova-compute[74646]:     <acpi/>
Oct 26 16:11:13 user nova-compute[74646]:     <apic/>
Oct 26 16:11:13 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:11:13 user nova-compute[74646]:   </features>
Oct 26 16:11:13 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:11:13 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:11:13 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:11:13 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:11:13 user nova-compute[74646]:   </clock>
Oct 26 16:11:13 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:11:13 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:11:13 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:11:13 user nova-compute[74646]:   </cpu>
Oct 26 16:11:13 user nova-compute[74646]:   <devices>
Oct 26 16:11:13 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:11:13 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:11:13 user nova-compute[74646]:       <source dev="/dev/sdb"/>
Oct 26 16:11:13 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:11:13 user nova-compute[74646]:       <serial>f8507f31-36cd-4435-9fbf-4e2659db518e</serial>
Oct 26 16:11:13 user nova-compute[74646]:     </disk>
Oct 26 16:11:13 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:11:13 user nova-compute[74646]:       <mac address="fa:16:3e:d9:39:0c"/>
Oct 26 16:11:13 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:11:13 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:11:13 user nova-compute[74646]:       <target dev="tapd4171750-84"/>
Oct 26 16:11:13 user nova-compute[74646]:     </interface>
Oct 26 16:11:13 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:11:13 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/console.log" append="off"/>
Oct 26 16:11:13 user nova-compute[74646]:     </serial>
Oct 26 16:11:13 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:11:13 user nova-compute[74646]:     <video>
Oct 26 16:11:13 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:11:13 user nova-compute[74646]:     </video>
Oct 26 16:11:13 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:11:13 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:11:13 user nova-compute[74646]:     </rng>
Oct 26 16:11:13 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:11:13 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:11:13 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:11:13 user nova-compute[74646]:     </memballoon>
Oct 26 16:11:13 user nova-compute[74646]:   </devices>
Oct 26 16:11:13 user nova-compute[74646]: </domain>
Oct 26 16:11:13 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:10:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1368171435',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1368171435',id=35,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='90e848952345455183c15fee816b6f12',ramdisk_id='',reservation_id='r-fhizlcr9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-580785668',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:10:37Z,user_data=None,user_id='abd7a869c235467ca4da99867c6bc0d4',uuid=f70f8714-4267-481f-bf97-e0afe03668a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converting VIF {"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:39:0c,bridge_name='br-int',has_traffic_filtering=True,id=d4171750-840e-4ebb-b99a-262d03c7e7a2,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4171750-84') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG os_vif [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:39:0c,bridge_name='br-int',has_traffic_filtering=True,id=d4171750-840e-4ebb-b99a-262d03c7e7a2,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4171750-84') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a17d8bca-eed9-5b64-b112-8908fed6fce9', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4171750-84, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd4171750-84, col_values=(('qos', UUID('7e177e22-a65d-4cac-ad34-20b589f45fcb')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd4171750-84, col_values=(('external_ids', {'iface-id': 'd4171750-840e-4ebb-b99a-262d03c7e7a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:39:0c', 'vm-uuid': 'f70f8714-4267-481f-bf97-e0afe03668a9'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:13 user nova-compute[74646]: INFO os_vif [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:39:0c,bridge_name='br-int',has_traffic_filtering=True,id=d4171750-840e-4ebb-b99a-262d03c7e7a2,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4171750-84')
Oct 26 16:11:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:11:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] No VIF found with MAC fa:16:3e:d9:39:0c, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:11:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-15a29af3-ae70-43ee-ab34-e44ef3712939 req-d2c8114b-bd5d-4760-82e4-0a5c3a31e359 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:11:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-15a29af3-ae70-43ee-ab34-e44ef3712939 req-d2c8114b-bd5d-4760-82e4-0a5c3a31e359 service nova] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-15a29af3-ae70-43ee-ab34-e44ef3712939 req-d2c8114b-bd5d-4760-82e4-0a5c3a31e359 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-15a29af3-ae70-43ee-ab34-e44ef3712939 req-d2c8114b-bd5d-4760-82e4-0a5c3a31e359 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-15a29af3-ae70-43ee-ab34-e44ef3712939 req-d2c8114b-bd5d-4760-82e4-0a5c3a31e359 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] No waiting events found dispatching network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:11:15 user nova-compute[74646]: WARNING nova.compute.manager [req-15a29af3-ae70-43ee-ab34-e44ef3712939 req-d2c8114b-bd5d-4760-82e4-0a5c3a31e359 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received unexpected event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 for instance with vm_state building and task_state spawning.
Oct 26 16:11:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:17 user nova-compute[74646]: DEBUG nova.compute.manager [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:11:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:11:17 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Instance spawned successfully.
Oct 26 16:11:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:11:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:17 user nova-compute[74646]: INFO nova.compute.manager [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Took 5.18 seconds to spawn the instance on the hypervisor.
Oct 26 16:11:17 user nova-compute[74646]: DEBUG nova.compute.manager [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:11:17 user nova-compute[74646]: INFO nova.compute.manager [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Took 41.98 seconds to build instance.
Oct 26 16:11:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-33953f54-a027-45a7-9518-eea75b43244e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "f70f8714-4267-481f-bf97-e0afe03668a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.448s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-1fa7a68e-34a7-4ca0-ac2c-75fc517a3ec3 req-551464ed-a558-4c1c-8ad4-2fc28a4222e9 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:11:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1fa7a68e-34a7-4ca0-ac2c-75fc517a3ec3 req-551464ed-a558-4c1c-8ad4-2fc28a4222e9 service nova] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1fa7a68e-34a7-4ca0-ac2c-75fc517a3ec3 req-551464ed-a558-4c1c-8ad4-2fc28a4222e9 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1fa7a68e-34a7-4ca0-ac2c-75fc517a3ec3 req-551464ed-a558-4c1c-8ad4-2fc28a4222e9 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-1fa7a68e-34a7-4ca0-ac2c-75fc517a3ec3 req-551464ed-a558-4c1c-8ad4-2fc28a4222e9 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] No waiting events found dispatching network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:11:17 user nova-compute[74646]: WARNING nova.compute.manager [req-1fa7a68e-34a7-4ca0-ac2c-75fc517a3ec3 req-551464ed-a558-4c1c-8ad4-2fc28a4222e9 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received unexpected event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 for instance with vm_state active and task_state None.
Oct 26 16:11:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "2bc4a961-4a5f-4477-8603-823adb496736" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "2bc4a961-4a5f-4477-8603-823adb496736" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:24 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:11:25 user nova-compute[74646]: INFO nova.compute.claims [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Claim successful on node user
Oct 26 16:11:25 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:11:25 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:11:25 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG nova.policy [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41c8a2a8c5594cca9451ab93e681dcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b251085ed49c991eef6c2df0b0990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:11:25 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Creating image(s)
Oct 26 16:11:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "/opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "/opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.179s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.178s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:25 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk 1073741824" returned: 0 in 0.094s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Successfully created port: 7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.229s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Cannot resize image /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Ensure instance console log exists: /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Successfully updated port: 7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "refresh_cache-2bc4a961-4a5f-4477-8603-823adb496736" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquired lock "refresh_cache-2bc4a961-4a5f-4477-8603-823adb496736" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-3220f827-58e5-4560-a5a0-4083ca859b1b req-9d0b0e25-b2db-4e09-9f49-166be73738cf service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Received event network-changed-7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-3220f827-58e5-4560-a5a0-4083ca859b1b req-9d0b0e25-b2db-4e09-9f49-166be73738cf service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Refreshing instance network info cache due to event network-changed-7344b2ea-bf85-4757-af64-b1b1a6f70c6f. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3220f827-58e5-4560-a5a0-4083ca859b1b req-9d0b0e25-b2db-4e09-9f49-166be73738cf service nova] Acquiring lock "refresh_cache-2bc4a961-4a5f-4477-8603-823adb496736" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:11:26 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.network.neutron [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Updating instance_info_cache with network_info: [{"id": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "address": "fa:16:3e:1c:5e:22", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7344b2ea-bf", "ovs_interfaceid": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Releasing lock "refresh_cache-2bc4a961-4a5f-4477-8603-823adb496736" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Instance network_info: |[{"id": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "address": "fa:16:3e:1c:5e:22", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7344b2ea-bf", "ovs_interfaceid": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3220f827-58e5-4560-a5a0-4083ca859b1b req-9d0b0e25-b2db-4e09-9f49-166be73738cf service nova] Acquired lock "refresh_cache-2bc4a961-4a5f-4477-8603-823adb496736" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.network.neutron [req-3220f827-58e5-4560-a5a0-4083ca859b1b req-9d0b0e25-b2db-4e09-9f49-166be73738cf service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Refreshing network info cache for port 7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Start _get_guest_xml network_info=[{"id": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "address": "fa:16:3e:1c:5e:22", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7344b2ea-bf", "ovs_interfaceid": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:11:27 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:11:27 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-26792070',display_name='tempest-AttachVolumeNegativeTest-server-26792070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-26792070',id=37,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpBC8LDsMQ5R5y4zYW5ywpBiYTotUCG3noYuVyt3OFFTT2Pghdzfy9WQxZaYwfyKwigbUJ+lEqg7R1Mx+RT9B/aDasZxHJfbUfPZKmDjF8VZ0hbK79n8+sCHM+CtQ6prQ==',key_name='tempest-keypair-833234407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f24b251085ed49c991eef6c2df0b0990',ramdisk_id='',reservation_id='r-g6peo3v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-340789388',owner_user_name='tempest-AttachVolumeNegativeTest-340789388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:11:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41c8a2a8c5594cca9451ab93e681dcd0',uuid=2bc4a961-4a5f-4477-8603-823adb496736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "address": "fa:16:3e:1c:5e:22", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7344b2ea-bf", "ovs_interfaceid": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converting VIF {"id": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "address": "fa:16:3e:1c:5e:22", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7344b2ea-bf", "ovs_interfaceid": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:5e:22,bridge_name='br-int',has_traffic_filtering=True,id=7344b2ea-bf85-4757-af64-b1b1a6f70c6f,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7344b2ea-bf') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.objects.instance [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bc4a961-4a5f-4477-8603-823adb496736 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:11:27 user nova-compute[74646]:   <uuid>2bc4a961-4a5f-4477-8603-823adb496736</uuid>
Oct 26 16:11:27 user nova-compute[74646]:   <name>instance-00000025</name>
Oct 26 16:11:27 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:11:27 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:11:27 user nova-compute[74646]:   <metadata>
Oct 26 16:11:27 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:11:27 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:11:27 user nova-compute[74646]:       <nova:name>tempest-AttachVolumeNegativeTest-server-26792070</nova:name>
Oct 26 16:11:27 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:11:27</nova:creationTime>
Oct 26 16:11:27 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:11:27 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:11:27 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:11:27 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:11:27 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:11:27 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:11:27 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:11:27 user nova-compute[74646]:       <nova:owner>
Oct 26 16:11:27 user nova-compute[74646]:         <nova:user uuid="41c8a2a8c5594cca9451ab93e681dcd0">tempest-AttachVolumeNegativeTest-340789388-project-member</nova:user>
Oct 26 16:11:27 user nova-compute[74646]:         <nova:project uuid="f24b251085ed49c991eef6c2df0b0990">tempest-AttachVolumeNegativeTest-340789388</nova:project>
Oct 26 16:11:27 user nova-compute[74646]:       </nova:owner>
Oct 26 16:11:27 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:11:27 user nova-compute[74646]:       <nova:ports>
Oct 26 16:11:27 user nova-compute[74646]:         <nova:port uuid="7344b2ea-bf85-4757-af64-b1b1a6f70c6f">
Oct 26 16:11:27 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 16:11:27 user nova-compute[74646]:         </nova:port>
Oct 26 16:11:27 user nova-compute[74646]:       </nova:ports>
Oct 26 16:11:27 user nova-compute[74646]:     </nova:instance>
Oct 26 16:11:27 user nova-compute[74646]:   </metadata>
Oct 26 16:11:27 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:11:27 user nova-compute[74646]:     <system>
Oct 26 16:11:27 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:11:27 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:11:27 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:11:27 user nova-compute[74646]:       <entry name="serial">2bc4a961-4a5f-4477-8603-823adb496736</entry>
Oct 26 16:11:27 user nova-compute[74646]:       <entry name="uuid">2bc4a961-4a5f-4477-8603-823adb496736</entry>
Oct 26 16:11:27 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:11:27 user nova-compute[74646]:     </system>
Oct 26 16:11:27 user nova-compute[74646]:   </sysinfo>
Oct 26 16:11:27 user nova-compute[74646]:   <os>
Oct 26 16:11:27 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:11:27 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:11:27 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:11:27 user nova-compute[74646]:   </os>
Oct 26 16:11:27 user nova-compute[74646]:   <features>
Oct 26 16:11:27 user nova-compute[74646]:     <acpi/>
Oct 26 16:11:27 user nova-compute[74646]:     <apic/>
Oct 26 16:11:27 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:11:27 user nova-compute[74646]:   </features>
Oct 26 16:11:27 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:11:27 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:11:27 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:11:27 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:11:27 user nova-compute[74646]:   </clock>
Oct 26 16:11:27 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:11:27 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:11:27 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:11:27 user nova-compute[74646]:   </cpu>
Oct 26 16:11:27 user nova-compute[74646]:   <devices>
Oct 26 16:11:27 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:11:27 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:11:27 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk"/>
Oct 26 16:11:27 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:11:27 user nova-compute[74646]:     </disk>
Oct 26 16:11:27 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:11:27 user nova-compute[74646]:       <mac address="fa:16:3e:1c:5e:22"/>
Oct 26 16:11:27 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:11:27 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:11:27 user nova-compute[74646]:       <target dev="tap7344b2ea-bf"/>
Oct 26 16:11:27 user nova-compute[74646]:     </interface>
Oct 26 16:11:27 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:11:27 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/console.log" append="off"/>
Oct 26 16:11:27 user nova-compute[74646]:     </serial>
Oct 26 16:11:27 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:11:27 user nova-compute[74646]:     <video>
Oct 26 16:11:27 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:11:27 user nova-compute[74646]:     </video>
Oct 26 16:11:27 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:11:27 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:11:27 user nova-compute[74646]:     </rng>
Oct 26 16:11:27 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:11:27 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:11:27 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:11:27 user nova-compute[74646]:     </memballoon>
Oct 26 16:11:27 user nova-compute[74646]:   </devices>
Oct 26 16:11:27 user nova-compute[74646]: </domain>
Oct 26 16:11:27 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-26792070',display_name='tempest-AttachVolumeNegativeTest-server-26792070',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-26792070',id=37,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpBC8LDsMQ5R5y4zYW5ywpBiYTotUCG3noYuVyt3OFFTT2Pghdzfy9WQxZaYwfyKwigbUJ+lEqg7R1Mx+RT9B/aDasZxHJfbUfPZKmDjF8VZ0hbK79n8+sCHM+CtQ6prQ==',key_name='tempest-keypair-833234407',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f24b251085ed49c991eef6c2df0b0990',ramdisk_id='',reservation_id='r-g6peo3v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-340789388',owner_user_name='tempest-AttachVolumeNegativeTest-340789388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:11:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41c8a2a8c5594cca9451ab93e681dcd0',uuid=2bc4a961-4a5f-4477-8603-823adb496736,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "address": "fa:16:3e:1c:5e:22", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7344b2ea-bf", "ovs_interfaceid": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converting VIF {"id": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "address": "fa:16:3e:1c:5e:22", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7344b2ea-bf", "ovs_interfaceid": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1c:5e:22,bridge_name='br-int',has_traffic_filtering=True,id=7344b2ea-bf85-4757-af64-b1b1a6f70c6f,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7344b2ea-bf') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG os_vif [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:5e:22,bridge_name='br-int',has_traffic_filtering=True,id=7344b2ea-bf85-4757-af64-b1b1a6f70c6f,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7344b2ea-bf') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23fe2f99-cdcc-54be-96b5-7b810c7b744c', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7344b2ea-bf, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7344b2ea-bf, col_values=(('qos', UUID('511d5393-49dc-4e5a-a9f2-87a72b7bf031')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7344b2ea-bf, col_values=(('external_ids', {'iface-id': '7344b2ea-bf85-4757-af64-b1b1a6f70c6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1c:5e:22', 'vm-uuid': '2bc4a961-4a5f-4477-8603-823adb496736'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:27 user nova-compute[74646]: INFO os_vif [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1c:5e:22,bridge_name='br-int',has_traffic_filtering=True,id=7344b2ea-bf85-4757-af64-b1b1a6f70c6f,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7344b2ea-bf')
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] No VIF found with MAC fa:16:3e:1c:5e:22, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.network.neutron [req-3220f827-58e5-4560-a5a0-4083ca859b1b req-9d0b0e25-b2db-4e09-9f49-166be73738cf service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Updated VIF entry in instance network info cache for port 7344b2ea-bf85-4757-af64-b1b1a6f70c6f. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG nova.network.neutron [req-3220f827-58e5-4560-a5a0-4083ca859b1b req-9d0b0e25-b2db-4e09-9f49-166be73738cf service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Updating instance_info_cache with network_info: [{"id": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "address": "fa:16:3e:1c:5e:22", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7344b2ea-bf", "ovs_interfaceid": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:11:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3220f827-58e5-4560-a5a0-4083ca859b1b req-9d0b0e25-b2db-4e09-9f49-166be73738cf service nova] Releasing lock "refresh_cache-2bc4a961-4a5f-4477-8603-823adb496736" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:11:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-42880778-6a40-4bb3-aa87-aa4d869eb685 req-7be6c2f4-f070-4e94-bae6-751c7df2bec4 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Received event network-vif-plugged-7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:11:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-42880778-6a40-4bb3-aa87-aa4d869eb685 req-7be6c2f4-f070-4e94-bae6-751c7df2bec4 service nova] Acquiring lock "2bc4a961-4a5f-4477-8603-823adb496736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-42880778-6a40-4bb3-aa87-aa4d869eb685 req-7be6c2f4-f070-4e94-bae6-751c7df2bec4 service nova] Lock "2bc4a961-4a5f-4477-8603-823adb496736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-42880778-6a40-4bb3-aa87-aa4d869eb685 req-7be6c2f4-f070-4e94-bae6-751c7df2bec4 service nova] Lock "2bc4a961-4a5f-4477-8603-823adb496736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:29 user nova-compute[74646]: DEBUG nova.compute.manager [req-42880778-6a40-4bb3-aa87-aa4d869eb685 req-7be6c2f4-f070-4e94-bae6-751c7df2bec4 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] No waiting events found dispatching network-vif-plugged-7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:11:29 user nova-compute[74646]: WARNING nova.compute.manager [req-42880778-6a40-4bb3-aa87-aa4d869eb685 req-7be6c2f4-f070-4e94-bae6-751c7df2bec4 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Received unexpected event network-vif-plugged-7344b2ea-bf85-4757-af64-b1b1a6f70c6f for instance with vm_state building and task_state spawning.
Oct 26 16:11:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:29 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:11:30 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Creating image(s)
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Ensure instance console log exists: /opt/stack/data/nova/instances/508f43f1-6d5c-41ed-9e4f-06eec0bc992e/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Start _get_guest_xml network_info=[{"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'dd0d5a7b-7f54-4f66-bb0e-6bc3724907fe', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNBOtrTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '508f43f1-6d5c-41ed-9e4f-06eec0bc992e', 'attached_at': '', 'detached_at': '', 'volume_id': '55cab237-57fe-4ecb-aba7-a1827f4ecdbe', 'serial': '55cab237-57fe-4ecb-aba7-a1827f4ecdbe'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:11:30 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:11:30 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNBOtrTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:11:30 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:11:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:11:30 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:11:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:11:30 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc29dc0-bba3-4ea9-ae59-d88e9f4a3312]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:11:30 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda1bc72-2e55-422c-a331-823cecf2cff6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe] added
Oct 26 16:11:30 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d25191-8767-4e93-bb0b-b2cff6cc1f76]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[76032384-f2d2-474e-b667-626ed83426de]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNBOtrTU {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNBOtrTU" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[84798ba7-f5b8-4810-a077-31759834d0b1]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iNBOtrTU'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3b6f07-ebcf-4ce3-9858-8ca6c33e33ee]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2af21a4-1c30-406c-a9b9-12925fc4989e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:11:30 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:11:30 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:11:30 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:11:30 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:11:30 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:11:30 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:11:30 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Instance spawned successfully.
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:30 user nova-compute[74646]: INFO nova.compute.manager [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Took 5.31 seconds to spawn the instance on the hypervisor.
Oct 26 16:11:30 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:11:31 user nova-compute[74646]: INFO nova.compute.manager [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Took 6.02 seconds to build instance.
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ddd23bd7-8646-46fd-9e25-8f546cbe6655 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "2bc4a961-4a5f-4477-8603-823adb496736" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.126s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG nova.compute.manager [req-0bd25fcc-582d-40d4-8f2c-81f5a38b9046 req-bf6008a3-32cc-4305-b189-4a278f86f633 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Received event network-vif-plugged-7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0bd25fcc-582d-40d4-8f2c-81f5a38b9046 req-bf6008a3-32cc-4305-b189-4a278f86f633 service nova] Acquiring lock "2bc4a961-4a5f-4477-8603-823adb496736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0bd25fcc-582d-40d4-8f2c-81f5a38b9046 req-bf6008a3-32cc-4305-b189-4a278f86f633 service nova] Lock "2bc4a961-4a5f-4477-8603-823adb496736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0bd25fcc-582d-40d4-8f2c-81f5a38b9046 req-bf6008a3-32cc-4305-b189-4a278f86f633 service nova] Lock "2bc4a961-4a5f-4477-8603-823adb496736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG nova.compute.manager [req-0bd25fcc-582d-40d4-8f2c-81f5a38b9046 req-bf6008a3-32cc-4305-b189-4a278f86f633 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] No waiting events found dispatching network-vif-plugged-7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:11:31 user nova-compute[74646]: WARNING nova.compute.manager [req-0bd25fcc-582d-40d4-8f2c-81f5a38b9046 req-bf6008a3-32cc-4305-b189-4a278f86f633 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Received unexpected event network-vif-plugged-7344b2ea-bf85-4757-af64-b1b1a6f70c6f for instance with vm_state active and task_state None.
Oct 26 16:11:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --login" returned: 0 in 1.069s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[261f4d8d-3528-496c-ad0b-62c8ff08502c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260]
Oct 26 16:11:31 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260] successful.
Oct 26 16:11:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45aea2f-d479-4754-ba5d-aff1a21f897b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ec187b-7efe-4039-b647-899cfbe6be10]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:11:31 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:11:31 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:11:31 user nova-compute[74646]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:11:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:11:31 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:11:31 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:11:31 user nova-compute[74646]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:11:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.307s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] HCTL ('35', '-', '-', 0) found on session 43 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e142af-23af-48c8-9249-adc4f292ede5]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Searching for a device in session 43 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:11:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNBOtrTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.339s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] <== connect_volume: return (2341ms) {'type': 'block', 'scsi_wwn': '23464623731363734', 'path': '/dev/sdd'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464623731363734', 'path': '/dev/sdd'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1418828722',display_name='tempest-TestShelveInstance-server-1418828722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1418828722',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK2eHzEUaiGM5e5vpC9TarAxO4Mz7lrRG1J0qSm/+2qJRDNi3DljnpTw20ljayeJeyEhD9W2UNlOqdrFNjtV+EnKppj50o3I4hdhJ4vIwUnPqg91zAuepcDmr91vbFC8Q==',key_name='tempest-TestShelveInstance-1854031540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d6af06081e14055b3b812f706d5ef20',ramdisk_id='',reservation_id='r-g1u9k9d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-48608582',owner_user_name='tempest-TestShelveInstance-48608582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:11:11Z,user_data=None,user_id='35ad85c745c94ba983e147c8dd2dcbc2',uuid=508f43f1-6d5c-41ed-9e4f-06eec0bc992e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Converting VIF {"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:2f:b6,bridge_name='br-int',has_traffic_filtering=True,id=c86c4c00-d0ce-47d4-94d0-bf17114750a4,network=Network(841be5f4-a63c-4f93-aa53-42702b4ccd16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86c4c00-d0') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG nova.objects.instance [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lazy-loading 'pci_devices' on Instance uuid 508f43f1-6d5c-41ed-9e4f-06eec0bc992e {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:11:32 user nova-compute[74646]:   <uuid>508f43f1-6d5c-41ed-9e4f-06eec0bc992e</uuid>
Oct 26 16:11:32 user nova-compute[74646]:   <name>instance-00000024</name>
Oct 26 16:11:32 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:11:32 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:11:32 user nova-compute[74646]:   <metadata>
Oct 26 16:11:32 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:11:32 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:11:32 user nova-compute[74646]:       <nova:name>tempest-TestShelveInstance-server-1418828722</nova:name>
Oct 26 16:11:32 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:11:30</nova:creationTime>
Oct 26 16:11:32 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:11:32 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:11:32 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:11:32 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:11:32 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:11:32 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:11:32 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:11:32 user nova-compute[74646]:       <nova:owner>
Oct 26 16:11:32 user nova-compute[74646]:         <nova:user uuid="35ad85c745c94ba983e147c8dd2dcbc2">tempest-TestShelveInstance-48608582-project-member</nova:user>
Oct 26 16:11:32 user nova-compute[74646]:         <nova:project uuid="7d6af06081e14055b3b812f706d5ef20">tempest-TestShelveInstance-48608582</nova:project>
Oct 26 16:11:32 user nova-compute[74646]:       </nova:owner>
Oct 26 16:11:32 user nova-compute[74646]:       <nova:ports>
Oct 26 16:11:32 user nova-compute[74646]:         <nova:port uuid="c86c4c00-d0ce-47d4-94d0-bf17114750a4">
Oct 26 16:11:32 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 16:11:32 user nova-compute[74646]:         </nova:port>
Oct 26 16:11:32 user nova-compute[74646]:       </nova:ports>
Oct 26 16:11:32 user nova-compute[74646]:     </nova:instance>
Oct 26 16:11:32 user nova-compute[74646]:   </metadata>
Oct 26 16:11:32 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:11:32 user nova-compute[74646]:     <system>
Oct 26 16:11:32 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:11:32 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:11:32 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:11:32 user nova-compute[74646]:       <entry name="serial">508f43f1-6d5c-41ed-9e4f-06eec0bc992e</entry>
Oct 26 16:11:32 user nova-compute[74646]:       <entry name="uuid">508f43f1-6d5c-41ed-9e4f-06eec0bc992e</entry>
Oct 26 16:11:32 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:11:32 user nova-compute[74646]:     </system>
Oct 26 16:11:32 user nova-compute[74646]:   </sysinfo>
Oct 26 16:11:32 user nova-compute[74646]:   <os>
Oct 26 16:11:32 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:11:32 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:11:32 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:11:32 user nova-compute[74646]:   </os>
Oct 26 16:11:32 user nova-compute[74646]:   <features>
Oct 26 16:11:32 user nova-compute[74646]:     <acpi/>
Oct 26 16:11:32 user nova-compute[74646]:     <apic/>
Oct 26 16:11:32 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:11:32 user nova-compute[74646]:   </features>
Oct 26 16:11:32 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:11:32 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:11:32 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:11:32 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:11:32 user nova-compute[74646]:   </clock>
Oct 26 16:11:32 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:11:32 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:11:32 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:11:32 user nova-compute[74646]:   </cpu>
Oct 26 16:11:32 user nova-compute[74646]:   <devices>
Oct 26 16:11:32 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:11:32 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:11:32 user nova-compute[74646]:       <source dev="/dev/sdd"/>
Oct 26 16:11:32 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:11:32 user nova-compute[74646]:       <serial>55cab237-57fe-4ecb-aba7-a1827f4ecdbe</serial>
Oct 26 16:11:32 user nova-compute[74646]:     </disk>
Oct 26 16:11:32 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:11:32 user nova-compute[74646]:       <mac address="fa:16:3e:13:2f:b6"/>
Oct 26 16:11:32 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:11:32 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:11:32 user nova-compute[74646]:       <target dev="tapc86c4c00-d0"/>
Oct 26 16:11:32 user nova-compute[74646]:     </interface>
Oct 26 16:11:32 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:11:32 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/508f43f1-6d5c-41ed-9e4f-06eec0bc992e/console.log" append="off"/>
Oct 26 16:11:32 user nova-compute[74646]:     </serial>
Oct 26 16:11:32 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:11:32 user nova-compute[74646]:     <video>
Oct 26 16:11:32 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:11:32 user nova-compute[74646]:     </video>
Oct 26 16:11:32 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:11:32 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:11:32 user nova-compute[74646]:     </rng>
Oct 26 16:11:32 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:11:32 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:11:32 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:11:32 user nova-compute[74646]:     </memballoon>
Oct 26 16:11:32 user nova-compute[74646]:   </devices>
Oct 26 16:11:32 user nova-compute[74646]: </domain>
Oct 26 16:11:32 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1418828722',display_name='tempest-TestShelveInstance-server-1418828722',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1418828722',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK2eHzEUaiGM5e5vpC9TarAxO4Mz7lrRG1J0qSm/+2qJRDNi3DljnpTw20ljayeJeyEhD9W2UNlOqdrFNjtV+EnKppj50o3I4hdhJ4vIwUnPqg91zAuepcDmr91vbFC8Q==',key_name='tempest-TestShelveInstance-1854031540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d6af06081e14055b3b812f706d5ef20',ramdisk_id='',reservation_id='r-g1u9k9d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-48608582',owner_user_name='tempest-TestShelveInstance-48608582-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:11:11Z,user_data=None,user_id='35ad85c745c94ba983e147c8dd2dcbc2',uuid=508f43f1-6d5c-41ed-9e4f-06eec0bc992e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Converting VIF {"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:2f:b6,bridge_name='br-int',has_traffic_filtering=True,id=c86c4c00-d0ce-47d4-94d0-bf17114750a4,network=Network(841be5f4-a63c-4f93-aa53-42702b4ccd16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86c4c00-d0') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG os_vif [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:2f:b6,bridge_name='br-int',has_traffic_filtering=True,id=c86c4c00-d0ce-47d4-94d0-bf17114750a4,network=Network(841be5f4-a63c-4f93-aa53-42702b4ccd16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86c4c00-d0') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f14318d-e9cd-5374-bd46-a8befaa9cb47', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc86c4c00-d0, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc86c4c00-d0, col_values=(('qos', UUID('12f40b7d-f23d-4cb1-900d-2f701213717b')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc86c4c00-d0, col_values=(('external_ids', {'iface-id': 'c86c4c00-d0ce-47d4-94d0-bf17114750a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:2f:b6', 'vm-uuid': '508f43f1-6d5c-41ed-9e4f-06eec0bc992e'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:32 user nova-compute[74646]: INFO os_vif [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:2f:b6,bridge_name='br-int',has_traffic_filtering=True,id=c86c4c00-d0ce-47d4-94d0-bf17114750a4,network=Network(841be5f4-a63c-4f93-aa53-42702b4ccd16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86c4c00-d0')
Oct 26 16:11:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:11:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] No VIF found with MAC fa:16:3e:13:2f:b6, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:11:33 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:11:33 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:11:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:34 user nova-compute[74646]: DEBUG nova.compute.manager [req-185e6181-2fa5-400a-a137-cdce7a535392 req-897795c1-0da3-40f7-b1e4-cef64b5b3f7e service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:11:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-185e6181-2fa5-400a-a137-cdce7a535392 req-897795c1-0da3-40f7-b1e4-cef64b5b3f7e service nova] Acquiring lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-185e6181-2fa5-400a-a137-cdce7a535392 req-897795c1-0da3-40f7-b1e4-cef64b5b3f7e service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-185e6181-2fa5-400a-a137-cdce7a535392 req-897795c1-0da3-40f7-b1e4-cef64b5b3f7e service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:34 user nova-compute[74646]: DEBUG nova.compute.manager [req-185e6181-2fa5-400a-a137-cdce7a535392 req-897795c1-0da3-40f7-b1e4-cef64b5b3f7e service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] No waiting events found dispatching network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:11:34 user nova-compute[74646]: WARNING nova.compute.manager [req-185e6181-2fa5-400a-a137-cdce7a535392 req-897795c1-0da3-40f7-b1e4-cef64b5b3f7e service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received unexpected event network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 for instance with vm_state building and task_state spawning.
Oct 26 16:11:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:11:34 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:11:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:11:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:11:34 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:11:34 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updating instance_info_cache with network_info: [{"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-9e46d857-97e1-40a0-9232-57438a82f8c6" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG nova.compute.manager [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:11:36 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Instance spawned successfully.
Oct 26 16:11:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG nova.compute.manager [req-e82f1736-c3d7-48c5-a2e9-760995999e27 req-5c1639c0-2256-4284-83f9-7873904b4e1f service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e82f1736-c3d7-48c5-a2e9-760995999e27 req-5c1639c0-2256-4284-83f9-7873904b4e1f service nova] Acquiring lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e82f1736-c3d7-48c5-a2e9-760995999e27 req-5c1639c0-2256-4284-83f9-7873904b4e1f service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e82f1736-c3d7-48c5-a2e9-760995999e27 req-5c1639c0-2256-4284-83f9-7873904b4e1f service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG nova.compute.manager [req-e82f1736-c3d7-48c5-a2e9-760995999e27 req-5c1639c0-2256-4284-83f9-7873904b4e1f service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] No waiting events found dispatching network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:11:36 user nova-compute[74646]: WARNING nova.compute.manager [req-e82f1736-c3d7-48c5-a2e9-760995999e27 req-5c1639c0-2256-4284-83f9-7873904b4e1f service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received unexpected event network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 for instance with vm_state building and task_state spawning.
Oct 26 16:11:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:11:36 user nova-compute[74646]: INFO nova.compute.manager [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Took 6.21 seconds to spawn the instance on the hypervisor.
Oct 26 16:11:36 user nova-compute[74646]: DEBUG nova.compute.manager [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:36 user nova-compute[74646]: INFO nova.compute.manager [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Took 26.11 seconds to build instance.
Oct 26 16:11:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-fb6937bc-4285-4a41-9938-36574da2c845 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 26.209s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:11:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:11:37 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:11:37 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:11:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8128MB free_disk=25.20126724243164GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 511f84be-7779-4856-8611-9171c1b59d58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9e46d857-97e1-40a0-9232-57438a82f8c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance f70f8714-4267-481f-bf97-e0afe03668a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 508f43f1-6d5c-41ed-9e4f-06eec0bc992e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2bc4a961-4a5f-4477-8603-823adb496736 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.427s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:11:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:39 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:11:39 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:11:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:11:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:52 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:57 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:11:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "363a4854-229c-482c-9235-3bfa9a639519" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:12:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "363a4854-229c-482c-9235-3bfa9a639519" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:12:02 user nova-compute[74646]: DEBUG nova.compute.manager [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:12:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:12:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:12:02 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:12:02 user nova-compute[74646]: INFO nova.compute.claims [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Claim successful on node user
Oct 26 16:12:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:02 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:12:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:02 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:12:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.353s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:12:02 user nova-compute[74646]: DEBUG nova.compute.manager [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:12:02 user nova-compute[74646]: DEBUG nova.compute.manager [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:12:02 user nova-compute[74646]: DEBUG nova.network.neutron [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:12:02 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:12:02 user nova-compute[74646]: DEBUG nova.compute.manager [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:12:02 user nova-compute[74646]: DEBUG nova.policy [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9419f9603ca647269ed1cf42e233507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a984c8da90ff476191cd5aa5787032c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:12:02 user nova-compute[74646]: INFO nova.virt.block_device [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Booting with volume f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 at /dev/vda
Oct 26 16:12:02 user nova-compute[74646]: DEBUG os_brick.utils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c822fae7-06c9-407a-a638-626b833edf17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6006a7b-0448-4ea7-9af9-5eb1db337e64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[288aabb2-95cc-428e-b92e-63637c9b9a15]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6965e7a-6eff-4bd3-b366-0aa129a47cae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:12:03 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:12:03 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0740a1cc-1321-471e-8713-7b0aacec1d0b]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG os_brick.utils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== get_connector_properties: return (266ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Updating existing volume attachment record: 23ecae5e-09f3-4d2b-8eb6-f9ef56795e80 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:12:03 user nova-compute[74646]: DEBUG nova.network.neutron [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Successfully created port: 17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:12:04 user nova-compute[74646]: DEBUG nova.network.neutron [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Successfully updated port: 17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:12:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "refresh_cache-363a4854-229c-482c-9235-3bfa9a639519" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:12:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquired lock "refresh_cache-363a4854-229c-482c-9235-3bfa9a639519" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:12:04 user nova-compute[74646]: DEBUG nova.network.neutron [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:12:04 user nova-compute[74646]: DEBUG nova.compute.manager [req-1b0c2621-bb7b-47a5-b25e-242e8c4b6316 req-30b081d6-0868-42a6-87a7-6afa31e63579 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Received event network-changed-17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:12:04 user nova-compute[74646]: DEBUG nova.compute.manager [req-1b0c2621-bb7b-47a5-b25e-242e8c4b6316 req-30b081d6-0868-42a6-87a7-6afa31e63579 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Refreshing instance network info cache due to event network-changed-17add16e-23d8-4d31-b39e-caf8bbfd3b2c. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:12:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1b0c2621-bb7b-47a5-b25e-242e8c4b6316 req-30b081d6-0868-42a6-87a7-6afa31e63579 service nova] Acquiring lock "refresh_cache-363a4854-229c-482c-9235-3bfa9a639519" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:12:04 user nova-compute[74646]: DEBUG nova.network.neutron [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:12:04 user nova-compute[74646]: DEBUG nova.network.neutron [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Updating instance_info_cache with network_info: [{"id": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "address": "fa:16:3e:45:af:41", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17add16e-23", "ovs_interfaceid": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:12:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Releasing lock "refresh_cache-363a4854-229c-482c-9235-3bfa9a639519" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:12:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Instance network_info: |[{"id": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "address": "fa:16:3e:45:af:41", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17add16e-23", "ovs_interfaceid": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:12:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1b0c2621-bb7b-47a5-b25e-242e8c4b6316 req-30b081d6-0868-42a6-87a7-6afa31e63579 service nova] Acquired lock "refresh_cache-363a4854-229c-482c-9235-3bfa9a639519" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:12:04 user nova-compute[74646]: DEBUG nova.network.neutron [req-1b0c2621-bb7b-47a5-b25e-242e8c4b6316 req-30b081d6-0868-42a6-87a7-6afa31e63579 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Refreshing network info cache for port 17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:12:05 user nova-compute[74646]: DEBUG nova.network.neutron [req-1b0c2621-bb7b-47a5-b25e-242e8c4b6316 req-30b081d6-0868-42a6-87a7-6afa31e63579 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Updated VIF entry in instance network info cache for port 17add16e-23d8-4d31-b39e-caf8bbfd3b2c. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:12:05 user nova-compute[74646]: DEBUG nova.network.neutron [req-1b0c2621-bb7b-47a5-b25e-242e8c4b6316 req-30b081d6-0868-42a6-87a7-6afa31e63579 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Updating instance_info_cache with network_info: [{"id": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "address": "fa:16:3e:45:af:41", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17add16e-23", "ovs_interfaceid": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:12:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1b0c2621-bb7b-47a5-b25e-242e8c4b6316 req-30b081d6-0868-42a6-87a7-6afa31e63579 service nova] Releasing lock "refresh_cache-363a4854-229c-482c-9235-3bfa9a639519" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:12:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:12:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 16:12:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:12:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:12:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:12:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 16:12:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:12:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:12:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:12:22 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Creating image(s)
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Ensure instance console log exists: /opt/stack/data/nova/instances/363a4854-229c-482c-9235-3bfa9a639519/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Start _get_guest_xml network_info=[{"id": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "address": "fa:16:3e:45:af:41", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17add16e-23", "ovs_interfaceid": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '23ecae5e-09f3-4d2b-8eb6-f9ef56795e80', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocESsuLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '363a4854-229c-482c-9235-3bfa9a639519', 'attached_at': '', 'detached_at': '', 'volume_id': 'f37b06a8-2fb2-47e1-b42b-9223a5f9dd89', 'serial': 'f37b06a8-2fb2-47e1-b42b-9223a5f9dd89'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:12:22 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:12:22 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocESsuLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:12:22 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:12:22 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:12:22 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76470d1-39b2-4eef-8fdd-5e9178e146b8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:12:22 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dee7ac4-7c58-428d-9ae1-36f30b017e3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89] added
Oct 26 16:12:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a228bc-ed20-4666-af39-ca92672216c1]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f63db29-1fe4-4acc-a08d-a17570bc5790]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ocESsuLr {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ocESsuLr" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ef3a05-f87b-465a-b3df-2859b897bf52]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ocESsuLr'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e19ed0d-cb4d-4eb8-9580-f97989efd865]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0317189f-7e33-40d8-a815-ea34467164af]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:12:22 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:12:22 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:12:22 user nova-compute[74646]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:12:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:12:22 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:12:22 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:12:22 user nova-compute[74646]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:12:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec1ac67-34bf-4223-9308-7dd2236b6e31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260]
Oct 26 16:12:22 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260] successful.
Oct 26 16:12:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67bb0a8-d540-49ea-b2b9-4f8bf456be85]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0f8f1e-289d-4e12-8a06-ff1522ceaff4]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:12:22 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:12:22 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:12:22 user nova-compute[74646]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:12:22 user nova-compute[74646]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:12:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:12:22 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:12:22 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:12:22 user nova-compute[74646]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:12:22 user nova-compute[74646]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:12:22 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] HCTL ('37', '-', '-', 0) found on session 44 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d770dfc7-159f-4363-a236-a82df80281e5]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: None {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:12:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching for a device in session 44 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocESsuLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23261366663323962', 'path': '/dev/sdf'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261366663323962', 'path': '/dev/sdf'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:12:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-333630312',display_name='tempest-TestVolumeBootPattern-server-333630312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-333630312',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcrhPEoRoaB0ki3RmOaZ3eTquho7+8b0QqO8Voy8+ev28RwRqncTnJ8yqJ/AeeNTkufE9hPbEWGpSzdo215+QWyfPE53vOWOtQaI8OQeut+svp088xcotWDN6W4cNUpMQ==',key_name='tempest-TestVolumeBootPattern-371467899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-d9r070p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:12:03Z,user_data=None,user_id='9419f9603ca647269ed1cf42e233507f',uuid=363a4854-229c-482c-9235-3bfa9a639519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "address": "fa:16:3e:45:af:41", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17add16e-23", "ovs_interfaceid": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "address": "fa:16:3e:45:af:41", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17add16e-23", "ovs_interfaceid": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:af:41,bridge_name='br-int',has_traffic_filtering=True,id=17add16e-23d8-4d31-b39e-caf8bbfd3b2c,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17add16e-23') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG nova.objects.instance [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lazy-loading 'pci_devices' on Instance uuid 363a4854-229c-482c-9235-3bfa9a639519 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:12:23 user nova-compute[74646]:   <uuid>363a4854-229c-482c-9235-3bfa9a639519</uuid>
Oct 26 16:12:23 user nova-compute[74646]:   <name>instance-00000026</name>
Oct 26 16:12:23 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:12:23 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:12:23 user nova-compute[74646]:   <metadata>
Oct 26 16:12:23 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:12:23 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:12:23 user nova-compute[74646]:       <nova:name>tempest-TestVolumeBootPattern-server-333630312</nova:name>
Oct 26 16:12:23 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:12:22</nova:creationTime>
Oct 26 16:12:23 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:12:23 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:12:23 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:12:23 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:12:23 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:12:23 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:12:23 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:12:23 user nova-compute[74646]:       <nova:owner>
Oct 26 16:12:23 user nova-compute[74646]:         <nova:user uuid="9419f9603ca647269ed1cf42e233507f">tempest-TestVolumeBootPattern-1231840017-project-member</nova:user>
Oct 26 16:12:23 user nova-compute[74646]:         <nova:project uuid="a984c8da90ff476191cd5aa5787032c1">tempest-TestVolumeBootPattern-1231840017</nova:project>
Oct 26 16:12:23 user nova-compute[74646]:       </nova:owner>
Oct 26 16:12:23 user nova-compute[74646]:       <nova:ports>
Oct 26 16:12:23 user nova-compute[74646]:         <nova:port uuid="17add16e-23d8-4d31-b39e-caf8bbfd3b2c">
Oct 26 16:12:23 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 26 16:12:23 user nova-compute[74646]:         </nova:port>
Oct 26 16:12:23 user nova-compute[74646]:       </nova:ports>
Oct 26 16:12:23 user nova-compute[74646]:     </nova:instance>
Oct 26 16:12:23 user nova-compute[74646]:   </metadata>
Oct 26 16:12:23 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:12:23 user nova-compute[74646]:     <system>
Oct 26 16:12:23 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:12:23 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:12:23 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:12:23 user nova-compute[74646]:       <entry name="serial">363a4854-229c-482c-9235-3bfa9a639519</entry>
Oct 26 16:12:23 user nova-compute[74646]:       <entry name="uuid">363a4854-229c-482c-9235-3bfa9a639519</entry>
Oct 26 16:12:23 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:12:23 user nova-compute[74646]:     </system>
Oct 26 16:12:23 user nova-compute[74646]:   </sysinfo>
Oct 26 16:12:23 user nova-compute[74646]:   <os>
Oct 26 16:12:23 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:12:23 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:12:23 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:12:23 user nova-compute[74646]:   </os>
Oct 26 16:12:23 user nova-compute[74646]:   <features>
Oct 26 16:12:23 user nova-compute[74646]:     <acpi/>
Oct 26 16:12:23 user nova-compute[74646]:     <apic/>
Oct 26 16:12:23 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:12:23 user nova-compute[74646]:   </features>
Oct 26 16:12:23 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:12:23 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:12:23 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:12:23 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:12:23 user nova-compute[74646]:   </clock>
Oct 26 16:12:23 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:12:23 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:12:23 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:12:23 user nova-compute[74646]:   </cpu>
Oct 26 16:12:23 user nova-compute[74646]:   <devices>
Oct 26 16:12:23 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:12:23 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:12:23 user nova-compute[74646]:       <source dev="/dev/sdf"/>
Oct 26 16:12:23 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:12:23 user nova-compute[74646]:       <serial>f37b06a8-2fb2-47e1-b42b-9223a5f9dd89</serial>
Oct 26 16:12:23 user nova-compute[74646]:     </disk>
Oct 26 16:12:23 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:12:23 user nova-compute[74646]:       <mac address="fa:16:3e:45:af:41"/>
Oct 26 16:12:23 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:12:23 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:12:23 user nova-compute[74646]:       <target dev="tap17add16e-23"/>
Oct 26 16:12:23 user nova-compute[74646]:     </interface>
Oct 26 16:12:23 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:12:23 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/363a4854-229c-482c-9235-3bfa9a639519/console.log" append="off"/>
Oct 26 16:12:23 user nova-compute[74646]:     </serial>
Oct 26 16:12:23 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:12:23 user nova-compute[74646]:     <video>
Oct 26 16:12:23 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:12:23 user nova-compute[74646]:     </video>
Oct 26 16:12:23 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:12:23 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:12:23 user nova-compute[74646]:     </rng>
Oct 26 16:12:23 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:12:23 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:12:23 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:12:23 user nova-compute[74646]:     </memballoon>
Oct 26 16:12:23 user nova-compute[74646]:   </devices>
Oct 26 16:12:23 user nova-compute[74646]: </domain>
Oct 26 16:12:23 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:12:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-333630312',display_name='tempest-TestVolumeBootPattern-server-333630312',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-333630312',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcrhPEoRoaB0ki3RmOaZ3eTquho7+8b0QqO8Voy8+ev28RwRqncTnJ8yqJ/AeeNTkufE9hPbEWGpSzdo215+QWyfPE53vOWOtQaI8OQeut+svp088xcotWDN6W4cNUpMQ==',key_name='tempest-TestVolumeBootPattern-371467899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-d9r070p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:12:03Z,user_data=None,user_id='9419f9603ca647269ed1cf42e233507f',uuid=363a4854-229c-482c-9235-3bfa9a639519,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "address": "fa:16:3e:45:af:41", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17add16e-23", "ovs_interfaceid": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "address": "fa:16:3e:45:af:41", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17add16e-23", "ovs_interfaceid": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:af:41,bridge_name='br-int',has_traffic_filtering=True,id=17add16e-23d8-4d31-b39e-caf8bbfd3b2c,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17add16e-23') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG os_vif [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:af:41,bridge_name='br-int',has_traffic_filtering=True,id=17add16e-23d8-4d31-b39e-caf8bbfd3b2c,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17add16e-23') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '424c2acb-5792-53a4-aa75-fb6eb2e4deac', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17add16e-23, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17add16e-23, col_values=(('qos', UUID('5822475b-b299-43f6-a464-714fcb8138fe')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17add16e-23, col_values=(('external_ids', {'iface-id': '17add16e-23d8-4d31-b39e-caf8bbfd3b2c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:af:41', 'vm-uuid': '363a4854-229c-482c-9235-3bfa9a639519'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:23 user nova-compute[74646]: INFO os_vif [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:af:41,bridge_name='br-int',has_traffic_filtering=True,id=17add16e-23d8-4d31-b39e-caf8bbfd3b2c,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17add16e-23')
Oct 26 16:12:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:12:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] No VIF found with MAC fa:16:3e:45:af:41, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:12:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:24 user nova-compute[74646]: DEBUG nova.compute.manager [req-4c2402da-5b2c-4872-9a6d-3624924d4398 req-4a725865-55bf-4763-b944-9ce72ff60f32 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Received event network-vif-plugged-17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:12:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4c2402da-5b2c-4872-9a6d-3624924d4398 req-4a725865-55bf-4763-b944-9ce72ff60f32 service nova] Acquiring lock "363a4854-229c-482c-9235-3bfa9a639519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:12:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4c2402da-5b2c-4872-9a6d-3624924d4398 req-4a725865-55bf-4763-b944-9ce72ff60f32 service nova] Lock "363a4854-229c-482c-9235-3bfa9a639519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:12:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4c2402da-5b2c-4872-9a6d-3624924d4398 req-4a725865-55bf-4763-b944-9ce72ff60f32 service nova] Lock "363a4854-229c-482c-9235-3bfa9a639519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:12:24 user nova-compute[74646]: DEBUG nova.compute.manager [req-4c2402da-5b2c-4872-9a6d-3624924d4398 req-4a725865-55bf-4763-b944-9ce72ff60f32 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] No waiting events found dispatching network-vif-plugged-17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:12:24 user nova-compute[74646]: WARNING nova.compute.manager [req-4c2402da-5b2c-4872-9a6d-3624924d4398 req-4a725865-55bf-4763-b944-9ce72ff60f32 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Received unexpected event network-vif-plugged-17add16e-23d8-4d31-b39e-caf8bbfd3b2c for instance with vm_state building and task_state spawning.
Oct 26 16:12:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:25 user nova-compute[74646]: INFO nova.compute.manager [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Rescuing
Oct 26 16:12:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "refresh_cache-f70f8714-4267-481f-bf97-e0afe03668a9" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:12:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquired lock "refresh_cache-f70f8714-4267-481f-bf97-e0afe03668a9" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:12:25 user nova-compute[74646]: DEBUG nova.network.neutron [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG nova.network.neutron [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Updating instance_info_cache with network_info: [{"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Releasing lock "refresh_cache-f70f8714-4267-481f-bf97-e0afe03668a9" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG nova.compute.manager [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:12:26 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Instance spawned successfully.
Oct 26 16:12:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:12:26 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:12:26 user nova-compute[74646]: INFO nova.compute.manager [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Took 4.95 seconds to spawn the instance on the hypervisor.
Oct 26 16:12:26 user nova-compute[74646]: DEBUG nova.compute.manager [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Received event network-vif-plugged-17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] Acquiring lock "363a4854-229c-482c-9235-3bfa9a639519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] Lock "363a4854-229c-482c-9235-3bfa9a639519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] Lock "363a4854-229c-482c-9235-3bfa9a639519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] No waiting events found dispatching network-vif-plugged-17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:12:27 user nova-compute[74646]: WARNING nova.compute.manager [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Received unexpected event network-vif-plugged-17add16e-23d8-4d31-b39e-caf8bbfd3b2c for instance with vm_state building and task_state spawning.
Oct 26 16:12:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-vif-unplugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] No waiting events found dispatching network-vif-unplugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:12:27 user nova-compute[74646]: WARNING nova.compute.manager [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received unexpected event network-vif-unplugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 for instance with vm_state active and task_state rescuing.
Oct 26 16:12:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] No waiting events found dispatching network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:12:27 user nova-compute[74646]: WARNING nova.compute.manager [req-9ab2341f-6781-41a0-95d9-4dc86e70d69d req-d72c7e65-acae-49b4-8107-a0194754dc58 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received unexpected event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 for instance with vm_state active and task_state rescuing.
Oct 26 16:12:27 user nova-compute[74646]: INFO nova.compute.manager [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Took 24.70 seconds to build instance.
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5f9698ec-6d9c-4a4f-ae64-ecd2c9374f5e tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "363a4854-229c-482c-9235-3bfa9a639519" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.799s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:12:27 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Instance destroyed successfully.
Oct 26 16:12:27 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Attempting a stable device rescue
Oct 26 16:12:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74646) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Instance directory exists: not creating {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 26 16:12:27 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Creating image(s)
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "/opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "/opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "/opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG nova.objects.instance [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'trusted_certs' on Instance uuid f70f8714-4267-481f-bf97-e0afe03668a9 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "28ec73ec731e0c3632d2b79ec4bc8baf47727609" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:12:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "28ec73ec731e0c3632d2b79ec4bc8baf47727609" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28ec73ec731e0c3632d2b79ec4bc8baf47727609.part --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28ec73ec731e0c3632d2b79ec4bc8baf47727609.part --force-share --output=json" returned: 0 in 0.226s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG nova.virt.images [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] 7195086b-9dca-47a8-8138-9322474c7971 was qcow2, converting to raw {{(pid=74646) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG nova.privsep.utils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74646) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/28ec73ec731e0c3632d2b79ec4bc8baf47727609.part /opt/stack/data/nova/instances/_base/28ec73ec731e0c3632d2b79ec4bc8baf47727609.converted {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/28ec73ec731e0c3632d2b79ec4bc8baf47727609.part /opt/stack/data/nova/instances/_base/28ec73ec731e0c3632d2b79ec4bc8baf47727609.converted" returned: 0 in 0.213s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28ec73ec731e0c3632d2b79ec4bc8baf47727609.converted --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28ec73ec731e0c3632d2b79ec4bc8baf47727609.converted --force-share --output=json" returned: 0 in 0.175s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "28ec73ec731e0c3632d2b79ec4bc8baf47727609" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.641s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "28ec73ec731e0c3632d2b79ec4bc8baf47727609" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "28ec73ec731e0c3632d2b79ec4bc8baf47727609" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28ec73ec731e0c3632d2b79ec4bc8baf47727609 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/28ec73ec731e0c3632d2b79ec4bc8baf47727609 --force-share --output=json" returned: 0 in 0.176s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28ec73ec731e0c3632d2b79ec4bc8baf47727609,backing_fmt=raw /opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/disk.rescue {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/28ec73ec731e0c3632d2b79ec4bc8baf47727609,backing_fmt=raw /opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/disk.rescue" returned: 0 in 0.047s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "28ec73ec731e0c3632d2b79ec4bc8baf47727609" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.objects.instance [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'migration_context' on Instance uuid f70f8714-4267-481f-bf97-e0afe03668a9 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.objects.base [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Object Instance<f70f8714-4267-481f-bf97-e0afe03668a9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Start _get_guest_xml network_info=[{"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "vif_mac": "fa:16:3e:d9:39:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '7195086b-9dca-47a8-8138-9322474c7971', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '711e061c-0d45-497f-bcc1-e76cbc343b3a', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upQzlafP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f70f8714-4267-481f-bf97-e0afe03668a9', 'attached_at': '', 'detached_at': '', 'volume_id': 'f8507f31-36cd-4435-9fbf-4e2659db518e', 'serial': 'f8507f31-36cd-4435-9fbf-4e2659db518e'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.objects.instance [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'resources' on Instance uuid f70f8714-4267-481f-bf97-e0afe03668a9 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.objects.base [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Object Instance<f70f8714-4267-481f-bf97-e0afe03668a9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.objects.instance [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'numa_topology' on Instance uuid f70f8714-4267-481f-bf97-e0afe03668a9 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.objects.base [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Object Instance<f70f8714-4267-481f-bf97-e0afe03668a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:12:29 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:12:29 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.objects.instance [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'vcpu_model' on Instance uuid f70f8714-4267-481f-bf97-e0afe03668a9 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.objects.base [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Object Instance<f70f8714-4267-481f-bf97-e0afe03668a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upQzlafP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:12:29 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:12:29 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:12:29 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ee8c96-5853-43e8-bf07-3d22e27f4aa8]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = upQzlafP\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 26 16:12:29 user nova-compute[74646]: node.name = iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e
Oct 26 16:12:29 user nova-compute[74646]: node.tpgt = -1
Oct 26 16:12:29 user nova-compute[74646]: node.startup = automatic
Oct 26 16:12:29 user nova-compute[74646]: node.leading_login = No
Oct 26 16:12:29 user nova-compute[74646]: iface.iscsi_ifacename = default
Oct 26 16:12:29 user nova-compute[74646]: iface.net_ifacename = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.ipaddress = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.prefix_len = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.hwaddress = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.transport_name = tcp
Oct 26 16:12:29 user nova-compute[74646]: iface.initiatorname = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.state = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.vlan_id = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.vlan_priority = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.vlan_state = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.iface_num = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.mtu = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.port = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.bootproto = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.subnet_mask = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.gateway = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.dhcp_alt_client_id_state = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.dhcp_alt_client_id = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.dhcp_dns = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.dhcp_learn_iqn = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.dhcp_req_vendor_id_state = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.dhcp_vendor_id_state = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.dhcp_vendor_id = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.dhcp_slp_da = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.fragmentation = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.gratuitous_arp = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.incoming_forwarding = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.tos_state = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.tos = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.ttl = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.delayed_ack = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.tcp_nagle = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.tcp_wsf_state = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.tcp_wsf = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.tcp_timer_scale = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.tcp_timestamp = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.redirect = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.def_task_mgmt_timeout = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.header_digest = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.data_digest = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.immediate_data = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.initial_r2t = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.data_seq_inorder = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.data_pdu_inorder = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.erl = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.max_receive_data_len = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.first_burst_len = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.max_outstanding_r2t = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.max_burst_len = 0
Oct 26 16:12:29 user nova-compute[74646]: iface.chap_auth = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.bidi_chap = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.strict_login_compliance = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.discovery_auth = <empty>
Oct 26 16:12:29 user nova-compute[74646]: iface.discovery_logout = <empty>
Oct 26 16:12:29 user nova-compute[74646]: node.discovery_address = <empty>
Oct 26 16:12:29 user nova-compute[74646]: node.discovery_port = 0
Oct 26 16:12:29 user nova-compute[74646]: node.discovery_type = static
Oct 26 16:12:29 user nova-compute[74646]: node.session.initial_cmdsn = 0
Oct 26 16:12:29 user nova-compute[74646]: node.session.initial_login_retry_max = 8
Oct 26 16:12:29 user nova-compute[74646]: node.session.xmit_thread_priority = -20
Oct 26 16:12:29 user nova-compute[74646]: node.session.cmds_max = 128
Oct 26 16:12:29 user nova-compute[74646]: node.session.queue_depth = 32
Oct 26 16:12:29 user nova-compute[74646]: node.session.nr_sessions = 1
Oct 26 16:12:29 user nova-compute[74646]: node.session.auth.authmethod = CHAP
Oct 26 16:12:29 user nova-compute[74646]: node.session.auth.username = upQzlafP
Oct 26 16:12:29 user nova-compute[74646]: node.session.auth.password = ***
Oct 26 16:12:29 user nova-compute[74646]: node.session.auth.username_in = <empty>
Oct 26 16:12:29 user nova-compute[74646]: node.session.auth.password_in = <empty>
Oct 26 16:12:29 user nova-compute[74646]: node.session.auth.chap_algs = MD5
Oct 26 16:12:29 user nova-compute[74646]: node.session.timeo.replacement_timeout = 120
Oct 26 16:12:29 user nova-compute[74646]: node.session.err_timeo.abort_timeout = 15
Oct 26 16:12:29 user nova-compute[74646]: node.session.err_timeo.lu_reset_timeout = 30
Oct 26 16:12:29 user nova-compute[74646]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 26 16:12:29 user nova-compute[74646]: node.session.err_timeo.host_reset_timeout = 60
Oct 26 16:12:29 user nova-compute[74646]: node.session.iscsi.FastAbort = Yes
Oct 26 16:12:29 user nova-compute[74646]: node.session.iscsi.InitialR2T = No
Oct 26 16:12:29 user nova-compute[74646]: node.session.iscsi.ImmediateData = Yes
Oct 26 16:12:29 user nova-compute[74646]: node.session.iscsi.FirstBurstLength = 262144
Oct 26 16:12:29 user nova-compute[74646]: node.session.iscsi.MaxBurstLength = 16776192
Oct 26 16:12:29 user nova-compute[74646]: node.session.iscsi.DefaultTime2Retain = 0
Oct 26 16:12:29 user nova-compute[74646]: node.session.iscsi.DefaultTime2Wait = 2
Oct 26 16:12:29 user nova-compute[74646]: node.session.iscsi.MaxConnections = 1
Oct 26 16:12:29 user nova-compute[74646]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 26 16:12:29 user nova-compute[74646]: node.session.iscsi.ERL = 0
Oct 26 16:12:29 user nova-compute[74646]: node.session.scan = manual
Oct 26 16:12:29 user nova-compute[74646]: node.session.reopen_max = 0
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].address = 172.16.0.220
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].port = 3260
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].startup = manual
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].tcp.window_size = 524288
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].tcp.type_of_service = 0
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].timeo.logout_timeout = 15
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].timeo.login_timeout = 15
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].timeo.auth_timeout = 45
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].timeo.noop_out_interval = 5
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].timeo.noop_out_timeout = 5
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].iscsi.HeaderDigest = None
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].iscsi.DataDigest = None
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].iscsi.IFMarker = No
Oct 26 16:12:29 user nova-compute[74646]: node.conn[0].iscsi.OFMarker = No
Oct 26 16:12:29 user nova-compute[74646]: # END RECORD
Oct 26 16:12:29 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf059f51-435d-4170-a61d-3bceaa1ede78]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[560c6937-598c-4ad9-8db5-ff0be0d5dfcd]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v upQzlafP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v upQzlafP" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d24597-e336-4066-b0f7-bb972ce65245]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'upQzlafP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c524250-d89f-4b77-901c-15517b454191]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cadf895-9254-4ea8-9984-74ec783a5dc1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:12:29 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:12:29 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:12:29 user nova-compute[74646]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:12:29 user nova-compute[74646]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:12:29 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:12:29 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:12:29 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:12:29 user nova-compute[74646]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:12:29 user nova-compute[74646]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:12:29 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.140s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] HCTL ('33', '0', '0', 0) found on session 42 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae404821-ca6e-4e02-a985-4d9f40cd117f]: (4, ('0 0 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Searching for a device in session 42 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upQzlafP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.163s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] <== connect_volume: return (165ms) {'type': 'block', 'scsi_wwn': '23834323739626535', 'path': '/dev/sdb'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834323739626535', 'path': '/dev/sdb'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:10:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1368171435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1368171435',id=35,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:11:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90e848952345455183c15fee816b6f12',ramdisk_id='',reservation_id='r-fhizlcr9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-580785668',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:11:17Z,user_data=None,user_id='abd7a869c235467ca4da99867c6bc0d4',uuid=f70f8714-4267-481f-bf97-e0afe03668a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "vif_mac": "fa:16:3e:d9:39:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converting VIF {"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "vif_mac": "fa:16:3e:d9:39:0c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:39:0c,bridge_name='br-int',has_traffic_filtering=True,id=d4171750-840e-4ebb-b99a-262d03c7e7a2,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4171750-84') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.objects.instance [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'pci_devices' on Instance uuid f70f8714-4267-481f-bf97-e0afe03668a9 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.objects.base [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Object Instance<f70f8714-4267-481f-bf97-e0afe03668a9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:12:29 user nova-compute[74646]:   <uuid>f70f8714-4267-481f-bf97-e0afe03668a9</uuid>
Oct 26 16:12:29 user nova-compute[74646]:   <name>instance-00000023</name>
Oct 26 16:12:29 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:12:29 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:12:29 user nova-compute[74646]:   <metadata>
Oct 26 16:12:29 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:12:29 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:12:29 user nova-compute[74646]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1368171435</nova:name>
Oct 26 16:12:29 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:12:29</nova:creationTime>
Oct 26 16:12:29 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:12:29 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:12:29 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:12:29 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:12:29 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:12:29 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:12:29 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:12:29 user nova-compute[74646]:       <nova:owner>
Oct 26 16:12:29 user nova-compute[74646]:         <nova:user uuid="abd7a869c235467ca4da99867c6bc0d4">tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member</nova:user>
Oct 26 16:12:29 user nova-compute[74646]:         <nova:project uuid="90e848952345455183c15fee816b6f12">tempest-ServerBootFromVolumeStableRescueTest-580785668</nova:project>
Oct 26 16:12:29 user nova-compute[74646]:       </nova:owner>
Oct 26 16:12:29 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:12:29 user nova-compute[74646]:       <nova:ports>
Oct 26 16:12:29 user nova-compute[74646]:         <nova:port uuid="d4171750-840e-4ebb-b99a-262d03c7e7a2">
Oct 26 16:12:29 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 26 16:12:29 user nova-compute[74646]:         </nova:port>
Oct 26 16:12:29 user nova-compute[74646]:       </nova:ports>
Oct 26 16:12:29 user nova-compute[74646]:     </nova:instance>
Oct 26 16:12:29 user nova-compute[74646]:   </metadata>
Oct 26 16:12:29 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:12:29 user nova-compute[74646]:     <system>
Oct 26 16:12:29 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:12:29 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:12:29 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:12:29 user nova-compute[74646]:       <entry name="serial">f70f8714-4267-481f-bf97-e0afe03668a9</entry>
Oct 26 16:12:29 user nova-compute[74646]:       <entry name="uuid">f70f8714-4267-481f-bf97-e0afe03668a9</entry>
Oct 26 16:12:29 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:12:29 user nova-compute[74646]:     </system>
Oct 26 16:12:29 user nova-compute[74646]:   </sysinfo>
Oct 26 16:12:29 user nova-compute[74646]:   <os>
Oct 26 16:12:29 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:12:29 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:12:29 user nova-compute[74646]:   </os>
Oct 26 16:12:29 user nova-compute[74646]:   <features>
Oct 26 16:12:29 user nova-compute[74646]:     <acpi/>
Oct 26 16:12:29 user nova-compute[74646]:     <apic/>
Oct 26 16:12:29 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:12:29 user nova-compute[74646]:   </features>
Oct 26 16:12:29 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:12:29 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:12:29 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:12:29 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:12:29 user nova-compute[74646]:   </clock>
Oct 26 16:12:29 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:12:29 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:12:29 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:12:29 user nova-compute[74646]:   </cpu>
Oct 26 16:12:29 user nova-compute[74646]:   <devices>
Oct 26 16:12:29 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:12:29 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:12:29 user nova-compute[74646]:       <source dev="/dev/sdb"/>
Oct 26 16:12:29 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:12:29 user nova-compute[74646]:       <serial>f8507f31-36cd-4435-9fbf-4e2659db518e</serial>
Oct 26 16:12:29 user nova-compute[74646]:     </disk>
Oct 26 16:12:29 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:12:29 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:12:29 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/disk.rescue"/>
Oct 26 16:12:29 user nova-compute[74646]:       <target dev="vdb" bus="virtio"/>
Oct 26 16:12:29 user nova-compute[74646]:       <boot order="1"/>
Oct 26 16:12:29 user nova-compute[74646]:     </disk>
Oct 26 16:12:29 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:12:29 user nova-compute[74646]:       <mac address="fa:16:3e:d9:39:0c"/>
Oct 26 16:12:29 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:12:29 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:12:29 user nova-compute[74646]:       <target dev="tapd4171750-84"/>
Oct 26 16:12:29 user nova-compute[74646]:     </interface>
Oct 26 16:12:29 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:12:29 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/console.log" append="off"/>
Oct 26 16:12:29 user nova-compute[74646]:     </serial>
Oct 26 16:12:29 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:12:29 user nova-compute[74646]:     <video>
Oct 26 16:12:29 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:12:29 user nova-compute[74646]:     </video>
Oct 26 16:12:29 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:12:29 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:12:29 user nova-compute[74646]:     </rng>
Oct 26 16:12:29 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:12:29 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:12:29 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:12:29 user nova-compute[74646]:     </memballoon>
Oct 26 16:12:29 user nova-compute[74646]:   </devices>
Oct 26 16:12:29 user nova-compute[74646]: </domain>
Oct 26 16:12:29 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:12:29 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Instance destroyed successfully.
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:12:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] No VIF found with MAC fa:16:3e:d9:39:0c, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:12:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:30 user nova-compute[74646]: DEBUG nova.compute.manager [req-c72559ba-c70b-459d-85e9-5b4db9e9572c req-5fd7b544-902d-41f1-8dbb-39cb873b5805 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:12:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c72559ba-c70b-459d-85e9-5b4db9e9572c req-5fd7b544-902d-41f1-8dbb-39cb873b5805 service nova] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:12:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c72559ba-c70b-459d-85e9-5b4db9e9572c req-5fd7b544-902d-41f1-8dbb-39cb873b5805 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:12:30 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c72559ba-c70b-459d-85e9-5b4db9e9572c req-5fd7b544-902d-41f1-8dbb-39cb873b5805 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:12:30 user nova-compute[74646]: DEBUG nova.compute.manager [req-c72559ba-c70b-459d-85e9-5b4db9e9572c req-5fd7b544-902d-41f1-8dbb-39cb873b5805 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] No waiting events found dispatching network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:12:30 user nova-compute[74646]: WARNING nova.compute.manager [req-c72559ba-c70b-459d-85e9-5b4db9e9572c req-5fd7b544-902d-41f1-8dbb-39cb873b5805 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received unexpected event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 for instance with vm_state active and task_state rescuing.
Oct 26 16:12:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:31 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:12:31 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:12:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-16e0d748-0980-4d0a-a932-0ba5c5b81532 req-023c3ffa-1d45-4caf-9384-a153bcc4ae54 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:12:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-16e0d748-0980-4d0a-a932-0ba5c5b81532 req-023c3ffa-1d45-4caf-9384-a153bcc4ae54 service nova] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:12:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-16e0d748-0980-4d0a-a932-0ba5c5b81532 req-023c3ffa-1d45-4caf-9384-a153bcc4ae54 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:12:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-16e0d748-0980-4d0a-a932-0ba5c5b81532 req-023c3ffa-1d45-4caf-9384-a153bcc4ae54 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:12:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-16e0d748-0980-4d0a-a932-0ba5c5b81532 req-023c3ffa-1d45-4caf-9384-a153bcc4ae54 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] No waiting events found dispatching network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:12:33 user nova-compute[74646]: WARNING nova.compute.manager [req-16e0d748-0980-4d0a-a932-0ba5c5b81532 req-023c3ffa-1d45-4caf-9384-a153bcc4ae54 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received unexpected event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 for instance with vm_state active and task_state rescuing.
Oct 26 16:12:33 user nova-compute[74646]: DEBUG nova.compute.manager [None req-7ad5a189-7da7-4f47-ba5f-dfc1e6eb4046 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:12:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:12:34 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:12:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-511f84be-7779-4856-8611-9171c1b59d58" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:12:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-511f84be-7779-4856-8611-9171c1b59d58" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:12:34 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:12:34 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Updating instance_info_cache with network_info: [{"id": "948b856f-3b22-4614-96ca-7349cf1b9343", "address": "fa:16:3e:db:bd:9d", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b856f-3b", "ovs_interfaceid": "948b856f-3b22-4614-96ca-7349cf1b9343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:12:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-511f84be-7779-4856-8611-9171c1b59d58" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:12:34 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:12:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:12:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:12:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:12:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:12:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:12:34 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:12:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:12:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:12:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:12:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:12:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/disk.rescue --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/disk.rescue --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:12:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:12:37 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:12:37 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:12:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=7983MB free_disk=25.067333221435547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 511f84be-7779-4856-8611-9171c1b59d58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9e46d857-97e1-40a0-9232-57438a82f8c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance f70f8714-4267-481f-bf97-e0afe03668a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 508f43f1-6d5c-41ed-9e4f-06eec0bc992e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2bc4a961-4a5f-4477-8603-823adb496736 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 363a4854-229c-482c-9235-3bfa9a639519 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:12:37 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:12:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:12:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:12:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:12:38 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:12:38 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:12:38 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:12:38 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:12:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:12:41 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:12:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:12:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 16:12:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:12:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:12:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:49 user nova-compute[74646]: INFO nova.compute.manager [None req-a06398ea-b81d-4bd9-9bf5-1323fa478a27 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Get console output
Oct 26 16:12:49 user nova-compute[74646]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 26 16:12:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:12:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-0539c5cb-db2e-4ecb-8633-d457d9ffbf0c req-1d06edbc-77b0-4367-95f0-b7b0de769e63 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-changed-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-0539c5cb-db2e-4ecb-8633-d457d9ffbf0c req-1d06edbc-77b0-4367-95f0-b7b0de769e63 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Refreshing instance network info cache due to event network-changed-c86c4c00-d0ce-47d4-94d0-bf17114750a4. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0539c5cb-db2e-4ecb-8633-d457d9ffbf0c req-1d06edbc-77b0-4367-95f0-b7b0de769e63 service nova] Acquiring lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0539c5cb-db2e-4ecb-8633-d457d9ffbf0c req-1d06edbc-77b0-4367-95f0-b7b0de769e63 service nova] Acquired lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG nova.network.neutron [req-0539c5cb-db2e-4ecb-8633-d457d9ffbf0c req-1d06edbc-77b0-4367-95f0-b7b0de769e63 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Refreshing network info cache for port c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG nova.network.neutron [req-0539c5cb-db2e-4ecb-8633-d457d9ffbf0c req-1d06edbc-77b0-4367-95f0-b7b0de769e63 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updated VIF entry in instance network info cache for port c86c4c00-d0ce-47d4-94d0-bf17114750a4. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG nova.network.neutron [req-0539c5cb-db2e-4ecb-8633-d457d9ffbf0c req-1d06edbc-77b0-4367-95f0-b7b0de769e63 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updating instance_info_cache with network_info: [{"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0539c5cb-db2e-4ecb-8633-d457d9ffbf0c req-1d06edbc-77b0-4367-95f0-b7b0de769e63 service nova] Releasing lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:02 user nova-compute[74646]: INFO nova.compute.manager [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Shelve offloading
Oct 26 16:13:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-9daffb18-210d-4461-bc76-87023bda135f req-d47c48ee-e8dc-49ad-8a74-a0989aecfe73 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-vif-unplugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9daffb18-210d-4461-bc76-87023bda135f req-d47c48ee-e8dc-49ad-8a74-a0989aecfe73 service nova] Acquiring lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9daffb18-210d-4461-bc76-87023bda135f req-d47c48ee-e8dc-49ad-8a74-a0989aecfe73 service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9daffb18-210d-4461-bc76-87023bda135f req-d47c48ee-e8dc-49ad-8a74-a0989aecfe73 service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:02 user nova-compute[74646]: DEBUG nova.compute.manager [req-9daffb18-210d-4461-bc76-87023bda135f req-d47c48ee-e8dc-49ad-8a74-a0989aecfe73 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] No waiting events found dispatching network-vif-unplugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:13:02 user nova-compute[74646]: WARNING nova.compute.manager [req-9daffb18-210d-4461-bc76-87023bda135f req-d47c48ee-e8dc-49ad-8a74-a0989aecfe73 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received unexpected event network-vif-unplugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 for instance with vm_state active and task_state shelving.
Oct 26 16:13:03 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Instance destroyed successfully.
Oct 26 16:13:03 user nova-compute[74646]: DEBUG nova.compute.manager [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:13:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:13:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquired lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:13:03 user nova-compute[74646]: DEBUG nova.network.neutron [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:13:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:03 user nova-compute[74646]: DEBUG nova.network.neutron [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updating instance_info_cache with network_info: [{"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:13:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Releasing lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:13:04 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Instance destroyed successfully.
Oct 26 16:13:04 user nova-compute[74646]: DEBUG nova.objects.instance [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lazy-loading 'resources' on Instance uuid 508f43f1-6d5c-41ed-9e4f-06eec0bc992e {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1418828722',display_name='tempest-TestShelveInstance-server-1418828722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1418828722',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK2eHzEUaiGM5e5vpC9TarAxO4Mz7lrRG1J0qSm/+2qJRDNi3DljnpTw20ljayeJeyEhD9W2UNlOqdrFNjtV+EnKppj50o3I4hdhJ4vIwUnPqg91zAuepcDmr91vbFC8Q==',key_name='tempest-TestShelveInstance-1854031540',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:11:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d6af06081e14055b3b812f706d5ef20',ramdisk_id='',reservation_id='r-g1u9k9d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-48608582',owner_user_name='tempest-TestShelveInstance-48608582-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:11:36Z,user_data=None,user_id='35ad85c745c94ba983e147c8dd2dcbc2',uuid=508f43f1-6d5c-41ed-9e4f-06eec0bc992e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Converting VIF {"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:2f:b6,bridge_name='br-int',has_traffic_filtering=True,id=c86c4c00-d0ce-47d4-94d0-bf17114750a4,network=Network(841be5f4-a63c-4f93-aa53-42702b4ccd16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86c4c00-d0') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_vif [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:2f:b6,bridge_name='br-int',has_traffic_filtering=True,id=c86c4c00-d0ce-47d4-94d0-bf17114750a4,network=Network(841be5f4-a63c-4f93-aa53-42702b4ccd16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86c4c00-d0') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc86c4c00-d0, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=12f40b7d-f23d-4cb1-900d-2f701213717b) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:13:04 user nova-compute[74646]: INFO os_vif [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:2f:b6,bridge_name='br-int',has_traffic_filtering=True,id=c86c4c00-d0ce-47d4-94d0-bf17114750a4,network=Network(841be5f4-a63c-4f93-aa53-42702b4ccd16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86c4c00-d0')
Oct 26 16:13:04 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNBOtrTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:13:04 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5ffa01-6664-4f96-b336-28d3d1ea1593]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:13:04 user nova-compute[74646]: No targets found.
Oct 26 16:13:04 user nova-compute[74646]: iSNS:
Oct 26 16:13:04 user nova-compute[74646]: No targets found.
Oct 26 16:13:04 user nova-compute[74646]: STATIC:
Oct 26 16:13:04 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89
Oct 26 16:13:04 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:13:04 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:13:04 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126
Oct 26 16:13:04 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:13:04 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:13:04 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:13:04 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:13:04 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:13:04 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe
Oct 26 16:13:04 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:13:04 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:13:04 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e
Oct 26 16:13:04 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:13:04 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:13:04 user nova-compute[74646]: FIRMWARE:
Oct 26 16:13:04 user nova-compute[74646]: No targets found.
Oct 26 16:13:04 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:13:04 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:13:04 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85f3c34-df0e-4467-a7b5-f5dec95d4c7c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0151167a-db06-481c-b0c6-e1bf1f397d97]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:13:04 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:13:04 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:13:04 user nova-compute[74646]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:13:04 user nova-compute[74646]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:13:04 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:13:04 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:13:04 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:13:04 user nova-compute[74646]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:13:04 user nova-compute[74646]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:13:04 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e83db0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe'): ({'sdd'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Removing single pathed devices sdd {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7c7eae-fa70-4df9-8ba9-d140fb4dcb9c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4ae093-0871-439c-870b-1026993da43d]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Flushing IO for device /dev/sdd {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08036d2-a326-4777-a03f-0746e2ea5718]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.034s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4ba067-cc5a-4cd7-85ce-0fa15418fed4]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.047s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7910a562-6f1e-4fff-a316-ad164e9a7080]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[74579001-bb4e-40d5-9688-06db210e5e91]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260]
Oct 26 16:13:04 user nova-compute[74646]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260] successful.
Oct 26 16:13:04 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f5a787-64f1-4e59-9155-e6576b71bf7d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] <== disconnect_volume: return (332ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:13:04 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Deleting instance files /opt/stack/data/nova/instances/508f43f1-6d5c-41ed-9e4f-06eec0bc992e_del
Oct 26 16:13:04 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Deletion of /opt/stack/data/nova/instances/508f43f1-6d5c-41ed-9e4f-06eec0bc992e_del complete
Oct 26 16:13:04 user nova-compute[74646]: DEBUG nova.compute.manager [req-e8a38945-01de-44c8-ac8b-152285efebf2 req-319c824a-cc69-4b8a-8c4e-e59fd29114ad service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e8a38945-01de-44c8-ac8b-152285efebf2 req-319c824a-cc69-4b8a-8c4e-e59fd29114ad service nova] Acquiring lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e8a38945-01de-44c8-ac8b-152285efebf2 req-319c824a-cc69-4b8a-8c4e-e59fd29114ad service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e8a38945-01de-44c8-ac8b-152285efebf2 req-319c824a-cc69-4b8a-8c4e-e59fd29114ad service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG nova.compute.manager [req-e8a38945-01de-44c8-ac8b-152285efebf2 req-319c824a-cc69-4b8a-8c4e-e59fd29114ad service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] No waiting events found dispatching network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:13:04 user nova-compute[74646]: WARNING nova.compute.manager [req-e8a38945-01de-44c8-ac8b-152285efebf2 req-319c824a-cc69-4b8a-8c4e-e59fd29114ad service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received unexpected event network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 for instance with vm_state active and task_state shelving.
Oct 26 16:13:04 user nova-compute[74646]: DEBUG nova.compute.manager [req-e8a38945-01de-44c8-ac8b-152285efebf2 req-319c824a-cc69-4b8a-8c4e-e59fd29114ad service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-changed-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG nova.compute.manager [req-e8a38945-01de-44c8-ac8b-152285efebf2 req-319c824a-cc69-4b8a-8c4e-e59fd29114ad service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Refreshing instance network info cache due to event network-changed-c86c4c00-d0ce-47d4-94d0-bf17114750a4. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e8a38945-01de-44c8-ac8b-152285efebf2 req-319c824a-cc69-4b8a-8c4e-e59fd29114ad service nova] Acquiring lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e8a38945-01de-44c8-ac8b-152285efebf2 req-319c824a-cc69-4b8a-8c4e-e59fd29114ad service nova] Acquired lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:13:04 user nova-compute[74646]: DEBUG nova.network.neutron [req-e8a38945-01de-44c8-ac8b-152285efebf2 req-319c824a-cc69-4b8a-8c4e-e59fd29114ad service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Refreshing network info cache for port c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:13:05 user nova-compute[74646]: DEBUG nova.network.neutron [req-e8a38945-01de-44c8-ac8b-152285efebf2 req-319c824a-cc69-4b8a-8c4e-e59fd29114ad service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updated VIF entry in instance network info cache for port c86c4c00-d0ce-47d4-94d0-bf17114750a4. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:13:05 user nova-compute[74646]: DEBUG nova.network.neutron [req-e8a38945-01de-44c8-ac8b-152285efebf2 req-319c824a-cc69-4b8a-8c4e-e59fd29114ad service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updating instance_info_cache with network_info: [{"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": null, "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:13:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e8a38945-01de-44c8-ac8b-152285efebf2 req-319c824a-cc69-4b8a-8c4e-e59fd29114ad service nova] Releasing lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:13:05 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Deleted allocations for instance 508f43f1-6d5c-41ed-9e4f-06eec0bc992e
Oct 26 16:13:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:05 user nova-compute[74646]: DEBUG nova.objects.instance [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lazy-loading 'numa_topology' on Instance uuid 508f43f1-6d5c-41ed-9e4f-06eec0bc992e {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:13:05 user nova-compute[74646]: DEBUG nova.objects.base [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Object Instance<508f43f1-6d5c-41ed-9e4f-06eec0bc992e> lazy-loaded attributes: resources,numa_topology {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:13:06 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:13:06 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:13:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-99dff7e2-3e68-4351-a0a1-9f6def844f6a tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.760s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-4b053e99-80ed-4b70-8a7f-a222f9ac7e64 req-d3ce63d9-aba6-4449-b45b-e17bff81c9b0 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Received event network-changed-7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-4b053e99-80ed-4b70-8a7f-a222f9ac7e64 req-d3ce63d9-aba6-4449-b45b-e17bff81c9b0 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Refreshing instance network info cache due to event network-changed-7344b2ea-bf85-4757-af64-b1b1a6f70c6f. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:13:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4b053e99-80ed-4b70-8a7f-a222f9ac7e64 req-d3ce63d9-aba6-4449-b45b-e17bff81c9b0 service nova] Acquiring lock "refresh_cache-2bc4a961-4a5f-4477-8603-823adb496736" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:13:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4b053e99-80ed-4b70-8a7f-a222f9ac7e64 req-d3ce63d9-aba6-4449-b45b-e17bff81c9b0 service nova] Acquired lock "refresh_cache-2bc4a961-4a5f-4477-8603-823adb496736" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:13:15 user nova-compute[74646]: DEBUG nova.network.neutron [req-4b053e99-80ed-4b70-8a7f-a222f9ac7e64 req-d3ce63d9-aba6-4449-b45b-e17bff81c9b0 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Refreshing network info cache for port 7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:13:16 user nova-compute[74646]: DEBUG nova.network.neutron [req-4b053e99-80ed-4b70-8a7f-a222f9ac7e64 req-d3ce63d9-aba6-4449-b45b-e17bff81c9b0 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Updated VIF entry in instance network info cache for port 7344b2ea-bf85-4757-af64-b1b1a6f70c6f. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:13:16 user nova-compute[74646]: DEBUG nova.network.neutron [req-4b053e99-80ed-4b70-8a7f-a222f9ac7e64 req-d3ce63d9-aba6-4449-b45b-e17bff81c9b0 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Updating instance_info_cache with network_info: [{"id": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "address": "fa:16:3e:1c:5e:22", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7344b2ea-bf", "ovs_interfaceid": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:13:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-4b053e99-80ed-4b70-8a7f-a222f9ac7e64 req-d3ce63d9-aba6-4449-b45b-e17bff81c9b0 service nova] Releasing lock "refresh_cache-2bc4a961-4a5f-4477-8603-823adb496736" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:13:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "2bc4a961-4a5f-4477-8603-823adb496736" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "2bc4a961-4a5f-4477-8603-823adb496736" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG nova.objects.instance [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lazy-loading 'flavor' on Instance uuid 2bc4a961-4a5f-4477-8603-823adb496736 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "2bc4a961-4a5f-4477-8603-823adb496736" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "2bc4a961-4a5f-4477-8603-823adb496736" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "2bc4a961-4a5f-4477-8603-823adb496736" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:21 user nova-compute[74646]: INFO nova.compute.manager [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Attaching volume b5d47359-f8a6-4aaf-a397-96255274e2ca to /dev/vdb
Oct 26 16:13:21 user nova-compute[74646]: DEBUG os_brick.utils [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41b8fd4-6a4a-4cc9-bdd0-8a90f6dbc92b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e339df-32c6-4cb2-9dc6-f877885e34be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03c5beb-968a-430f-8a5a-17ce86acaf0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03acd2a-c672-4d48-ae51-7569ad1c23f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:13:21 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:22 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:13:22 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:13:22 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba9e9c4-6c69-4b0a-ba62-5af62a8f6d03]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:13:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:13:22 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:13:22 user nova-compute[74646]: DEBUG os_brick.utils [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:13:22 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Updating existing volume attachment record: cb1245d3-c80b-4752-87ac-6cdcb8d38a9f {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:13:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:32 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:13:32 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:13:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:13:34 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:13:34 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Didn't find any instances for network info cache update. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 16:13:35 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:13:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:13:35 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:13:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:35 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:13:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:13:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:13:35 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:13:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/disk.rescue --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/disk.rescue --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:37 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:13:37 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:13:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8052MB free_disk=25.064640045166016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 511f84be-7779-4856-8611-9171c1b59d58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9e46d857-97e1-40a0-9232-57438a82f8c6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance f70f8714-4267-481f-bf97-e0afe03668a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2bc4a961-4a5f-4477-8603-823adb496736 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 363a4854-229c-482c-9235-3bfa9a639519 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:13:37 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:13:38 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:13:38 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:13:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:13:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:39 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:13:39 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:13:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMNEqoXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:13:40 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:13:40 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:13:40 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96036d3-d661-4a74-9ba2-24f8238eb3b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:13:40 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9eafb0-f579-4823-b2bf-aada43cffbcc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca] added
Oct 26 16:13:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e5848b-fcd7-49dd-865b-e1a61f5605ca]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e285ff-99d1-4317-873a-ae3d95feed66]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMNEqoXa {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xMNEqoXa" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b123c857-c2f1-49d5-80d3-4e803e2a6c99]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xMNEqoXa'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba62dcd-08ae-4d58-801e-82bfc409cc8d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8f456d-0124-4316-a63f-68213236a57b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:13:40 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:13:40 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:13:40 user nova-compute[74646]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:13:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:13:40 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:13:40 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:13:40 user nova-compute[74646]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:13:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a4b4e3-cc7b-46ff-a8f5-7d594babb373]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca, portal: 172.16.0.220,3260]
Oct 26 16:13:40 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca, portal: 172.16.0.220,3260] successful.
Oct 26 16:13:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[79341dd5-3b85-44e8-bb08-2d55b55aa4d5]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2689f1e6-41b0-4a18-ad6b-aef76fb9bd0d]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:13:40 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:13:40 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:13:40 user nova-compute[74646]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:13:40 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:13:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:13:40 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:13:40 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:13:40 user nova-compute[74646]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:13:40 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:13:40 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] HCTL ('35', '-', '-', 0) found on session 45 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3ce170-80ea-47c7-a020-406c6a90003a]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Searching for a device in session 45 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:13:40 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMNEqoXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:13:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:13:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23732393538336332', 'path': '/dev/sdd'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:13:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732393538336332', 'path': '/dev/sdd'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:13:41 user nova-compute[74646]: DEBUG nova.objects.instance [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lazy-loading 'flavor' on Instance uuid 2bc4a961-4a5f-4477-8603-823adb496736 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:13:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:13:41 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:13:41 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:13:41 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:13:41 user nova-compute[74646]:   <serial>b5d47359-f8a6-4aaf-a397-96255274e2ca</serial>
Oct 26 16:13:41 user nova-compute[74646]: </disk>
Oct 26 16:13:41 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:13:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:13:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:13:42 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] No VIF found with MAC fa:16:3e:1c:5e:22, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:13:42 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:13:42 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:13:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-32f3b36c-9a47-4c84-9826-8adbc31455e6 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "2bc4a961-4a5f-4477-8603-823adb496736" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.689s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:13:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "eae356d7-073d-434c-abad-74c56205d364" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "eae356d7-073d-434c-abad-74c56205d364" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:13:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:13:46 user nova-compute[74646]: INFO nova.compute.claims [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Claim successful on node user
Oct 26 16:13:46 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:13:46 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:13:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:13:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:13:46 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:13:46 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:13:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:13:46 user nova-compute[74646]: DEBUG nova.policy [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41c8a2a8c5594cca9451ab93e681dcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b251085ed49c991eef6c2df0b0990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:13:47 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Creating image(s)
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "/opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "/opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "/opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.173s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.173s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/disk 1073741824" returned: 0 in 0.052s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Successfully created port: 7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.182s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Cannot resize image /opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Ensure instance console log exists: /opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Successfully updated port: 7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "refresh_cache-eae356d7-073d-434c-abad-74c56205d364" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquired lock "refresh_cache-eae356d7-073d-434c-abad-74c56205d364" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-c2d1b01f-24ca-4355-96b3-c6062979f081 req-4d698c63-d57e-4933-b9dd-375378be748e service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Received event network-changed-7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-c2d1b01f-24ca-4355-96b3-c6062979f081 req-4d698c63-d57e-4933-b9dd-375378be748e service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Refreshing instance network info cache due to event network-changed-7c80870a-3c7c-4ead-b0ac-e257279721c0. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c2d1b01f-24ca-4355-96b3-c6062979f081 req-4d698c63-d57e-4933-b9dd-375378be748e service nova] Acquiring lock "refresh_cache-eae356d7-073d-434c-abad-74c56205d364" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Updating instance_info_cache with network_info: [{"id": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "address": "fa:16:3e:88:d3:3b", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c80870a-3c", "ovs_interfaceid": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Releasing lock "refresh_cache-eae356d7-073d-434c-abad-74c56205d364" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Instance network_info: |[{"id": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "address": "fa:16:3e:88:d3:3b", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c80870a-3c", "ovs_interfaceid": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c2d1b01f-24ca-4355-96b3-c6062979f081 req-4d698c63-d57e-4933-b9dd-375378be748e service nova] Acquired lock "refresh_cache-eae356d7-073d-434c-abad-74c56205d364" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.network.neutron [req-c2d1b01f-24ca-4355-96b3-c6062979f081 req-4d698c63-d57e-4933-b9dd-375378be748e service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Refreshing network info cache for port 7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Start _get_guest_xml network_info=[{"id": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "address": "fa:16:3e:88:d3:3b", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c80870a-3c", "ovs_interfaceid": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:13:48 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:13:48 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1739808527',display_name='tempest-AttachVolumeNegativeTest-server-1739808527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1739808527',id=39,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDGlRSpfJVHzxZBaQ2K1l6R9HWy9mxEE7WYIBF4Q7ncYOANKOTIl+a2r2BIWlXru6ARxDMtA0RnMQBwKyAf/dQ+SKEZDKQNKgEfBKdtIlQVxI/Jvll8TzFv8Je40dEYLw==',key_name='tempest-keypair-2100886243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f24b251085ed49c991eef6c2df0b0990',ramdisk_id='',reservation_id='r-hjxo4zi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-340789388',owner_user_name='tempest-AttachVolumeNegativeTest-340789388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41c8a2a8c5594cca9451ab93e681dcd0',uuid=eae356d7-073d-434c-abad-74c56205d364,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "address": "fa:16:3e:88:d3:3b", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c80870a-3c", "ovs_interfaceid": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converting VIF {"id": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "address": "fa:16:3e:88:d3:3b", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c80870a-3c", "ovs_interfaceid": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d3:3b,bridge_name='br-int',has_traffic_filtering=True,id=7c80870a-3c7c-4ead-b0ac-e257279721c0,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c80870a-3c') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.objects.instance [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lazy-loading 'pci_devices' on Instance uuid eae356d7-073d-434c-abad-74c56205d364 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:13:48 user nova-compute[74646]:   <uuid>eae356d7-073d-434c-abad-74c56205d364</uuid>
Oct 26 16:13:48 user nova-compute[74646]:   <name>instance-00000027</name>
Oct 26 16:13:48 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:13:48 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:13:48 user nova-compute[74646]:   <metadata>
Oct 26 16:13:48 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:13:48 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:13:48 user nova-compute[74646]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1739808527</nova:name>
Oct 26 16:13:48 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:13:48</nova:creationTime>
Oct 26 16:13:48 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:13:48 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:13:48 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:13:48 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:13:48 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:13:48 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:13:48 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:13:48 user nova-compute[74646]:       <nova:owner>
Oct 26 16:13:48 user nova-compute[74646]:         <nova:user uuid="41c8a2a8c5594cca9451ab93e681dcd0">tempest-AttachVolumeNegativeTest-340789388-project-member</nova:user>
Oct 26 16:13:48 user nova-compute[74646]:         <nova:project uuid="f24b251085ed49c991eef6c2df0b0990">tempest-AttachVolumeNegativeTest-340789388</nova:project>
Oct 26 16:13:48 user nova-compute[74646]:       </nova:owner>
Oct 26 16:13:48 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:13:48 user nova-compute[74646]:       <nova:ports>
Oct 26 16:13:48 user nova-compute[74646]:         <nova:port uuid="7c80870a-3c7c-4ead-b0ac-e257279721c0">
Oct 26 16:13:48 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 16:13:48 user nova-compute[74646]:         </nova:port>
Oct 26 16:13:48 user nova-compute[74646]:       </nova:ports>
Oct 26 16:13:48 user nova-compute[74646]:     </nova:instance>
Oct 26 16:13:48 user nova-compute[74646]:   </metadata>
Oct 26 16:13:48 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:13:48 user nova-compute[74646]:     <system>
Oct 26 16:13:48 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:13:48 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:13:48 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:13:48 user nova-compute[74646]:       <entry name="serial">eae356d7-073d-434c-abad-74c56205d364</entry>
Oct 26 16:13:48 user nova-compute[74646]:       <entry name="uuid">eae356d7-073d-434c-abad-74c56205d364</entry>
Oct 26 16:13:48 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:13:48 user nova-compute[74646]:     </system>
Oct 26 16:13:48 user nova-compute[74646]:   </sysinfo>
Oct 26 16:13:48 user nova-compute[74646]:   <os>
Oct 26 16:13:48 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:13:48 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:13:48 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:13:48 user nova-compute[74646]:   </os>
Oct 26 16:13:48 user nova-compute[74646]:   <features>
Oct 26 16:13:48 user nova-compute[74646]:     <acpi/>
Oct 26 16:13:48 user nova-compute[74646]:     <apic/>
Oct 26 16:13:48 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:13:48 user nova-compute[74646]:   </features>
Oct 26 16:13:48 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:13:48 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:13:48 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:13:48 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:13:48 user nova-compute[74646]:   </clock>
Oct 26 16:13:48 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:13:48 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:13:48 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:13:48 user nova-compute[74646]:   </cpu>
Oct 26 16:13:48 user nova-compute[74646]:   <devices>
Oct 26 16:13:48 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:13:48 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:13:48 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/disk"/>
Oct 26 16:13:48 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:13:48 user nova-compute[74646]:     </disk>
Oct 26 16:13:48 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:13:48 user nova-compute[74646]:       <mac address="fa:16:3e:88:d3:3b"/>
Oct 26 16:13:48 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:13:48 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:13:48 user nova-compute[74646]:       <target dev="tap7c80870a-3c"/>
Oct 26 16:13:48 user nova-compute[74646]:     </interface>
Oct 26 16:13:48 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:13:48 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/console.log" append="off"/>
Oct 26 16:13:48 user nova-compute[74646]:     </serial>
Oct 26 16:13:48 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:13:48 user nova-compute[74646]:     <video>
Oct 26 16:13:48 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:13:48 user nova-compute[74646]:     </video>
Oct 26 16:13:48 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:13:48 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:13:48 user nova-compute[74646]:     </rng>
Oct 26 16:13:48 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:13:48 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:13:48 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:13:48 user nova-compute[74646]:     </memballoon>
Oct 26 16:13:48 user nova-compute[74646]:   </devices>
Oct 26 16:13:48 user nova-compute[74646]: </domain>
Oct 26 16:13:48 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1739808527',display_name='tempest-AttachVolumeNegativeTest-server-1739808527',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1739808527',id=39,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDGlRSpfJVHzxZBaQ2K1l6R9HWy9mxEE7WYIBF4Q7ncYOANKOTIl+a2r2BIWlXru6ARxDMtA0RnMQBwKyAf/dQ+SKEZDKQNKgEfBKdtIlQVxI/Jvll8TzFv8Je40dEYLw==',key_name='tempest-keypair-2100886243',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f24b251085ed49c991eef6c2df0b0990',ramdisk_id='',reservation_id='r-hjxo4zi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-340789388',owner_user_name='tempest-AttachVolumeNegativeTest-340789388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41c8a2a8c5594cca9451ab93e681dcd0',uuid=eae356d7-073d-434c-abad-74c56205d364,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "address": "fa:16:3e:88:d3:3b", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c80870a-3c", "ovs_interfaceid": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converting VIF {"id": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "address": "fa:16:3e:88:d3:3b", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c80870a-3c", "ovs_interfaceid": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d3:3b,bridge_name='br-int',has_traffic_filtering=True,id=7c80870a-3c7c-4ead-b0ac-e257279721c0,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c80870a-3c') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG os_vif [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d3:3b,bridge_name='br-int',has_traffic_filtering=True,id=7c80870a-3c7c-4ead-b0ac-e257279721c0,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c80870a-3c') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c5f7c875-90bf-5165-82f8-4c07b26ab8cd', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c80870a-3c, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c80870a-3c, col_values=(('qos', UUID('e653b665-03e6-4679-840a-58a5e96ca227')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c80870a-3c, col_values=(('external_ids', {'iface-id': '7c80870a-3c7c-4ead-b0ac-e257279721c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:d3:3b', 'vm-uuid': 'eae356d7-073d-434c-abad-74c56205d364'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:48 user nova-compute[74646]: INFO os_vif [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d3:3b,bridge_name='br-int',has_traffic_filtering=True,id=7c80870a-3c7c-4ead-b0ac-e257279721c0,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c80870a-3c')
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:13:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] No VIF found with MAC fa:16:3e:88:d3:3b, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:13:49 user nova-compute[74646]: DEBUG nova.network.neutron [req-c2d1b01f-24ca-4355-96b3-c6062979f081 req-4d698c63-d57e-4933-b9dd-375378be748e service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Updated VIF entry in instance network info cache for port 7c80870a-3c7c-4ead-b0ac-e257279721c0. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:13:49 user nova-compute[74646]: DEBUG nova.network.neutron [req-c2d1b01f-24ca-4355-96b3-c6062979f081 req-4d698c63-d57e-4933-b9dd-375378be748e service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Updating instance_info_cache with network_info: [{"id": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "address": "fa:16:3e:88:d3:3b", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c80870a-3c", "ovs_interfaceid": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:13:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c2d1b01f-24ca-4355-96b3-c6062979f081 req-4d698c63-d57e-4933-b9dd-375378be748e service nova] Releasing lock "refresh_cache-eae356d7-073d-434c-abad-74c56205d364" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:13:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "9e46d857-97e1-40a0-9232-57438a82f8c6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:49 user nova-compute[74646]: INFO nova.compute.manager [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Terminating instance
Oct 26 16:13:49 user nova-compute[74646]: DEBUG nova.compute.manager [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:13:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-ff63daaf-a3e4-4662-b42a-ea290bfb8ccb req-522f7442-6e88-48db-8fd1-efe8197e7a2e service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Received event network-vif-plugged-7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ff63daaf-a3e4-4662-b42a-ea290bfb8ccb req-522f7442-6e88-48db-8fd1-efe8197e7a2e service nova] Acquiring lock "eae356d7-073d-434c-abad-74c56205d364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ff63daaf-a3e4-4662-b42a-ea290bfb8ccb req-522f7442-6e88-48db-8fd1-efe8197e7a2e service nova] Lock "eae356d7-073d-434c-abad-74c56205d364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ff63daaf-a3e4-4662-b42a-ea290bfb8ccb req-522f7442-6e88-48db-8fd1-efe8197e7a2e service nova] Lock "eae356d7-073d-434c-abad-74c56205d364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-ff63daaf-a3e4-4662-b42a-ea290bfb8ccb req-522f7442-6e88-48db-8fd1-efe8197e7a2e service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] No waiting events found dispatching network-vif-plugged-7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:13:50 user nova-compute[74646]: WARNING nova.compute.manager [req-ff63daaf-a3e4-4662-b42a-ea290bfb8ccb req-522f7442-6e88-48db-8fd1-efe8197e7a2e service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Received unexpected event network-vif-plugged-7c80870a-3c7c-4ead-b0ac-e257279721c0 for instance with vm_state building and task_state spawning.
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-e6a0eec4-3886-4e63-8500-db07baf9a46e req-492377bb-2492-449a-a64d-16d00740655c service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received event network-vif-unplugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e6a0eec4-3886-4e63-8500-db07baf9a46e req-492377bb-2492-449a-a64d-16d00740655c service nova] Acquiring lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e6a0eec4-3886-4e63-8500-db07baf9a46e req-492377bb-2492-449a-a64d-16d00740655c service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e6a0eec4-3886-4e63-8500-db07baf9a46e req-492377bb-2492-449a-a64d-16d00740655c service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-e6a0eec4-3886-4e63-8500-db07baf9a46e req-492377bb-2492-449a-a64d-16d00740655c service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] No waiting events found dispatching network-vif-unplugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-e6a0eec4-3886-4e63-8500-db07baf9a46e req-492377bb-2492-449a-a64d-16d00740655c service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received event network-vif-unplugged-898eb4a5-708b-4414-bc27-1413e1a1d978 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-e6a0eec4-3886-4e63-8500-db07baf9a46e req-492377bb-2492-449a-a64d-16d00740655c service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received event network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e6a0eec4-3886-4e63-8500-db07baf9a46e req-492377bb-2492-449a-a64d-16d00740655c service nova] Acquiring lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e6a0eec4-3886-4e63-8500-db07baf9a46e req-492377bb-2492-449a-a64d-16d00740655c service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e6a0eec4-3886-4e63-8500-db07baf9a46e req-492377bb-2492-449a-a64d-16d00740655c service nova] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-e6a0eec4-3886-4e63-8500-db07baf9a46e req-492377bb-2492-449a-a64d-16d00740655c service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] No waiting events found dispatching network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:13:50 user nova-compute[74646]: WARNING nova.compute.manager [req-e6a0eec4-3886-4e63-8500-db07baf9a46e req-492377bb-2492-449a-a64d-16d00740655c service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received unexpected event network-vif-plugged-898eb4a5-708b-4414-bc27-1413e1a1d978 for instance with vm_state active and task_state deleting.
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Instance destroyed successfully.
Oct 26 16:13:50 user nova-compute[74646]: DEBUG nova.objects.instance [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lazy-loading 'resources' on Instance uuid 9e46d857-97e1-40a0-9232-57438a82f8c6 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-700043270',display_name='tempest-ServerActionsTestOtherA-server-700043270',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-700043270',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFpQMuDQ9yV5cYwbhkTyRLOjZZ0Tl/sjjENeyylssja83c6EpW+JftZQ9mXXtyfrIqGGnek7tn477+zNOt3iNR5IPo2YdOD8TzgfFC3ul9nIufuOchmOZ60R0hjnHQdyg==',key_name='tempest-keypair-1269718539',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:09:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-an258biy',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:11:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=9e46d857-97e1-40a0-9232-57438a82f8c6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "898eb4a5-708b-4414-bc27-1413e1a1d978", "address": "fa:16:3e:c1:c7:e2", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap898eb4a5-70", "ovs_interfaceid": "898eb4a5-708b-4414-bc27-1413e1a1d978", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c7:e2,bridge_name='br-int',has_traffic_filtering=True,id=898eb4a5-708b-4414-bc27-1413e1a1d978,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898eb4a5-70') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG os_vif [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c7:e2,bridge_name='br-int',has_traffic_filtering=True,id=898eb4a5-708b-4414-bc27-1413e1a1d978,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898eb4a5-70') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap898eb4a5-70, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83f7c686-9e86-4a4d-8c0e-89c94a71db4e) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:50 user nova-compute[74646]: INFO os_vif [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c1:c7:e2,bridge_name='br-int',has_traffic_filtering=True,id=898eb4a5-708b-4414-bc27-1413e1a1d978,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap898eb4a5-70')
Oct 26 16:13:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HSPKulcT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:13:50 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:13:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e4d70f-778c-41b8-9e1d-601ee42a90df]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:13:50 user nova-compute[74646]: No targets found.
Oct 26 16:13:50 user nova-compute[74646]: iSNS:
Oct 26 16:13:50 user nova-compute[74646]: No targets found.
Oct 26 16:13:50 user nova-compute[74646]: STATIC:
Oct 26 16:13:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca
Oct 26 16:13:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:13:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:13:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89
Oct 26 16:13:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:13:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:13:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126
Oct 26 16:13:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:13:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:13:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:13:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:13:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:13:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e
Oct 26 16:13:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:13:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:13:50 user nova-compute[74646]: FIRMWARE:
Oct 26 16:13:50 user nova-compute[74646]: No targets found.
Oct 26 16:13:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:13:50 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:13:50 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1fed24-6dd1-4234-910d-fdee3e15d649]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bac19fb-d470-4845-bc78-b1f9352bb747]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:13:50 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:13:50 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:13:50 user nova-compute[74646]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:13:50 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:13:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:13:50 user nova-compute[74646]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 (non-flash)
Oct 26 16:13:50 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:13:50 user nova-compute[74646]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:13:50 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:13:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e01824d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126'): ({'sdc'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Removing single pathed devices sdc {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:13:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f15acfb5-16ee-4b55-98bc-287114117d12]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[44801046-4eb3-4135-b25e-f281678b7a6b]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Flushing IO for device /dev/sdc {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[680415f7-c15a-457b-892f-9cf07658640b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[56097c1e-03a2-432d-81c8-7df483ae581b]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_21d42095', '/dev/disk/by-id/scsi-1SCST_BIO21d42095-60fd8342cf464f34', '/dev/disk/by-id/scsi-23630666438333432') {{(pid=85624) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81c01e5-236d-42ed-b3d2-63937aa47e67]: (4, None) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fada52-69c7-4387-947c-d1576d053da5]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98c37fa-6fc2-4fa1-832b-a32c2c42d5a3]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260]
Oct 26 16:13:51 user nova-compute[74646]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126, portal: 172.16.0.220,3260] successful.
Oct 26 16:13:51 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eb9b9e63-b7e0-464b-b69f-aeac55c6d126 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[673653ce-df24-4f72-bc71-b797bbe76dd9]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] <== disconnect_volume: return (394ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:13:51 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Deleting instance files /opt/stack/data/nova/instances/9e46d857-97e1-40a0-9232-57438a82f8c6_del
Oct 26 16:13:51 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Deletion of /opt/stack/data/nova/instances/9e46d857-97e1-40a0-9232-57438a82f8c6_del complete
Oct 26 16:13:51 user nova-compute[74646]: INFO nova.compute.manager [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Took 1.60 seconds to destroy the instance on the hypervisor.
Oct 26 16:13:51 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:13:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:52 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:13:52 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Took 0.97 seconds to deallocate network for instance.
Oct 26 16:13:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-c8ed0e2b-61c3-4359-8a6a-19ec9b0d9f0f req-b42d86a2-6448-4bf9-86b4-5e322f951a40 service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Received event network-vif-plugged-7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c8ed0e2b-61c3-4359-8a6a-19ec9b0d9f0f req-b42d86a2-6448-4bf9-86b4-5e322f951a40 service nova] Acquiring lock "eae356d7-073d-434c-abad-74c56205d364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c8ed0e2b-61c3-4359-8a6a-19ec9b0d9f0f req-b42d86a2-6448-4bf9-86b4-5e322f951a40 service nova] Lock "eae356d7-073d-434c-abad-74c56205d364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c8ed0e2b-61c3-4359-8a6a-19ec9b0d9f0f req-b42d86a2-6448-4bf9-86b4-5e322f951a40 service nova] Lock "eae356d7-073d-434c-abad-74c56205d364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-c8ed0e2b-61c3-4359-8a6a-19ec9b0d9f0f req-b42d86a2-6448-4bf9-86b4-5e322f951a40 service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] No waiting events found dispatching network-vif-plugged-7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:13:52 user nova-compute[74646]: WARNING nova.compute.manager [req-c8ed0e2b-61c3-4359-8a6a-19ec9b0d9f0f req-b42d86a2-6448-4bf9-86b4-5e322f951a40 service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Received unexpected event network-vif-plugged-7c80870a-3c7c-4ead-b0ac-e257279721c0 for instance with vm_state building and task_state spawning.
Oct 26 16:13:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-acd9b634-9754-46d7-b12d-2f066d28b216 req-47ec8016-3ac9-4255-98d3-d01d14239029 service nova] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Received event network-vif-deleted-898eb4a5-708b-4414-bc27-1413e1a1d978 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:52 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:13:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:13:52 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: eae356d7-073d-434c-abad-74c56205d364] Instance spawned successfully.
Oct 26 16:13:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:13:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:13:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:13:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:13:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:13:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:13:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:13:52 user nova-compute[74646]: INFO nova.compute.manager [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Took 5.89 seconds to spawn the instance on the hypervisor.
Oct 26 16:13:52 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:13:53 user nova-compute[74646]: INFO nova.compute.manager [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Took 6.67 seconds to build instance.
Oct 26 16:13:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a91990ff-cf68-493e-a4a6-38b4dfcd64d1 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "eae356d7-073d-434c-abad-74c56205d364" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.761s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:53 user nova-compute[74646]: INFO nova.compute.manager [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Took 1.09 seconds to detach 1 volumes for instance.
Oct 26 16:13:53 user nova-compute[74646]: DEBUG nova.compute.manager [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9e46d857-97e1-40a0-9232-57438a82f8c6] Deleting volume: eb9b9e63-b7e0-464b-b69f-aeac55c6d126 {{(pid=74646) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 16:13:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:53 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:13:53 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:13:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:54 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Deleted allocations for instance 9e46d857-97e1-40a0-9232-57438a82f8c6
Oct 26 16:13:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-70988cd4-7a24-4bcf-8ac1-7befae9c48d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9e46d857-97e1-40a0-9232-57438a82f8c6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.375s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:54 user nova-compute[74646]: DEBUG nova.compute.manager [req-efa5c9f7-f46f-444d-a179-bc964fc70ff2 req-783d2836-8ff3-4602-a94b-ee835bda82bc service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Received event network-changed-17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:54 user nova-compute[74646]: DEBUG nova.compute.manager [req-efa5c9f7-f46f-444d-a179-bc964fc70ff2 req-783d2836-8ff3-4602-a94b-ee835bda82bc service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Refreshing instance network info cache due to event network-changed-17add16e-23d8-4d31-b39e-caf8bbfd3b2c. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:13:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-efa5c9f7-f46f-444d-a179-bc964fc70ff2 req-783d2836-8ff3-4602-a94b-ee835bda82bc service nova] Acquiring lock "refresh_cache-363a4854-229c-482c-9235-3bfa9a639519" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:13:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-efa5c9f7-f46f-444d-a179-bc964fc70ff2 req-783d2836-8ff3-4602-a94b-ee835bda82bc service nova] Acquired lock "refresh_cache-363a4854-229c-482c-9235-3bfa9a639519" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:13:54 user nova-compute[74646]: DEBUG nova.network.neutron [req-efa5c9f7-f46f-444d-a179-bc964fc70ff2 req-783d2836-8ff3-4602-a94b-ee835bda82bc service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Refreshing network info cache for port 17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG nova.network.neutron [req-efa5c9f7-f46f-444d-a179-bc964fc70ff2 req-783d2836-8ff3-4602-a94b-ee835bda82bc service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Updated VIF entry in instance network info cache for port 17add16e-23d8-4d31-b39e-caf8bbfd3b2c. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG nova.network.neutron [req-efa5c9f7-f46f-444d-a179-bc964fc70ff2 req-783d2836-8ff3-4602-a94b-ee835bda82bc service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Updating instance_info_cache with network_info: [{"id": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "address": "fa:16:3e:45:af:41", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.93", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17add16e-23", "ovs_interfaceid": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "363a4854-229c-482c-9235-3bfa9a639519" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "363a4854-229c-482c-9235-3bfa9a639519" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "363a4854-229c-482c-9235-3bfa9a639519-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "363a4854-229c-482c-9235-3bfa9a639519-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "363a4854-229c-482c-9235-3bfa9a639519-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:55 user nova-compute[74646]: INFO nova.compute.manager [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Terminating instance
Oct 26 16:13:55 user nova-compute[74646]: DEBUG nova.compute.manager [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-efa5c9f7-f46f-444d-a179-bc964fc70ff2 req-783d2836-8ff3-4602-a94b-ee835bda82bc service nova] Releasing lock "refresh_cache-363a4854-229c-482c-9235-3bfa9a639519" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-b91ffe82-cdd7-4e0a-b909-fa9ac353937a req-fe0b9b4a-ce7c-4820-8b6f-5f7841054370 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Received event network-vif-unplugged-17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b91ffe82-cdd7-4e0a-b909-fa9ac353937a req-fe0b9b4a-ce7c-4820-8b6f-5f7841054370 service nova] Acquiring lock "363a4854-229c-482c-9235-3bfa9a639519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b91ffe82-cdd7-4e0a-b909-fa9ac353937a req-fe0b9b4a-ce7c-4820-8b6f-5f7841054370 service nova] Lock "363a4854-229c-482c-9235-3bfa9a639519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b91ffe82-cdd7-4e0a-b909-fa9ac353937a req-fe0b9b4a-ce7c-4820-8b6f-5f7841054370 service nova] Lock "363a4854-229c-482c-9235-3bfa9a639519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-b91ffe82-cdd7-4e0a-b909-fa9ac353937a req-fe0b9b4a-ce7c-4820-8b6f-5f7841054370 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] No waiting events found dispatching network-vif-unplugged-17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG nova.compute.manager [req-b91ffe82-cdd7-4e0a-b909-fa9ac353937a req-fe0b9b4a-ce7c-4820-8b6f-5f7841054370 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Received event network-vif-unplugged-17add16e-23d8-4d31-b39e-caf8bbfd3b2c for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:55 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Instance destroyed successfully.
Oct 26 16:13:55 user nova-compute[74646]: DEBUG nova.objects.instance [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lazy-loading 'resources' on Instance uuid 363a4854-229c-482c-9235-3bfa9a639519 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:12:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-333630312',display_name='tempest-TestVolumeBootPattern-server-333630312',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-333630312',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcrhPEoRoaB0ki3RmOaZ3eTquho7+8b0QqO8Voy8+ev28RwRqncTnJ8yqJ/AeeNTkufE9hPbEWGpSzdo215+QWyfPE53vOWOtQaI8OQeut+svp088xcotWDN6W4cNUpMQ==',key_name='tempest-TestVolumeBootPattern-371467899',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:12:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-d9r070p9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:12:27Z,user_data=None,user_id='9419f9603ca647269ed1cf42e233507f',uuid=363a4854-229c-482c-9235-3bfa9a639519,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "address": "fa:16:3e:45:af:41", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17add16e-23", "ovs_interfaceid": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "address": "fa:16:3e:45:af:41", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17add16e-23", "ovs_interfaceid": "17add16e-23d8-4d31-b39e-caf8bbfd3b2c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:af:41,bridge_name='br-int',has_traffic_filtering=True,id=17add16e-23d8-4d31-b39e-caf8bbfd3b2c,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17add16e-23') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG os_vif [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:af:41,bridge_name='br-int',has_traffic_filtering=True,id=17add16e-23d8-4d31-b39e-caf8bbfd3b2c,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17add16e-23') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17add16e-23, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5822475b-b299-43f6-a464-714fcb8138fe) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:13:55 user nova-compute[74646]: INFO os_vif [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:af:41,bridge_name='br-int',has_traffic_filtering=True,id=17add16e-23d8-4d31-b39e-caf8bbfd3b2c,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17add16e-23')
Oct 26 16:13:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocESsuLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:13:55 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:13:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[55729b72-514d-459e-9b3b-7cbbc881d1cf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:13:55 user nova-compute[74646]: No targets found.
Oct 26 16:13:55 user nova-compute[74646]: iSNS:
Oct 26 16:13:55 user nova-compute[74646]: No targets found.
Oct 26 16:13:55 user nova-compute[74646]: STATIC:
Oct 26 16:13:55 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca
Oct 26 16:13:55 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:13:55 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:13:55 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89
Oct 26 16:13:55 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:13:55 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:13:55 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:13:55 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:13:55 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:13:55 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e
Oct 26 16:13:55 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:13:55 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:13:55 user nova-compute[74646]: FIRMWARE:
Oct 26 16:13:55 user nova-compute[74646]: No targets found.
Oct 26 16:13:55 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:13:55 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:13:55 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:13:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.040s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f09151e-ee6a-4d7e-b3c7-e8754f9f821b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[41cb3864-b2fb-4853-896a-992ffe66150c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:13:56 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:13:56 user nova-compute[74646]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:13:56 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:13:56 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:13:56 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:13:56 user nova-compute[74646]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:13:56 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:13:56 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9ea9e5000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89'): ({'sdf'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Removing single pathed devices sdf {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c055e5bb-a97f-4318-bc46-3f40ec30ccca]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b55b478-d048-4847-9799-0b36084e1edb]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flushing IO for device /dev/sdf {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f966c6-4df2-4692-8870-fd3a5a0db7e0]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad4c921-fdf6-4422-aac4-fe15116b43d1]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] SCSI volumes sdf have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23261366663323962', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_32f26705', '/dev/disk/by-id/scsi-1SCST_BIO32f26705-2a6fc29b88553a2a') {{(pid=85624) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[78860359-8213-4ad2-afb2-477580834950]: (4, None) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[32090a74-3f5b-4821-b873-5e95056974c8]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bfc4b05-9d64-45ce-940d-20a0094bf2b1]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260]
Oct 26 16:13:56 user nova-compute[74646]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260] successful.
Oct 26 16:13:56 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0910ed3-1180-4e21-9b7e-16769e5f0987]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== disconnect_volume: return (383ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:13:56 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Deleting instance files /opt/stack/data/nova/instances/363a4854-229c-482c-9235-3bfa9a639519_del
Oct 26 16:13:56 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Deletion of /opt/stack/data/nova/instances/363a4854-229c-482c-9235-3bfa9a639519_del complete
Oct 26 16:13:56 user nova-compute[74646]: INFO nova.compute.manager [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 26 16:13:56 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 363a4854-229c-482c-9235-3bfa9a639519] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:13:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:13:57 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:13:57 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Took 0.75 seconds to deallocate network for instance.
Oct 26 16:13:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-f0736575-4ed7-46f5-8eb6-8ea4ff0548ec req-f8145725-9ef6-4414-af2d-bd7bd08a54f0 service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Received event network-vif-deleted-17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-b7e4dc24-316f-40bd-b91b-0ee74a0fde3d req-175abd65-c4f0-4f04-8002-bf8243778ebb service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Received event network-vif-plugged-17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:13:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b7e4dc24-316f-40bd-b91b-0ee74a0fde3d req-175abd65-c4f0-4f04-8002-bf8243778ebb service nova] Acquiring lock "363a4854-229c-482c-9235-3bfa9a639519-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b7e4dc24-316f-40bd-b91b-0ee74a0fde3d req-175abd65-c4f0-4f04-8002-bf8243778ebb service nova] Lock "363a4854-229c-482c-9235-3bfa9a639519-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b7e4dc24-316f-40bd-b91b-0ee74a0fde3d req-175abd65-c4f0-4f04-8002-bf8243778ebb service nova] Lock "363a4854-229c-482c-9235-3bfa9a639519-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:57 user nova-compute[74646]: DEBUG nova.compute.manager [req-b7e4dc24-316f-40bd-b91b-0ee74a0fde3d req-175abd65-c4f0-4f04-8002-bf8243778ebb service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] No waiting events found dispatching network-vif-plugged-17add16e-23d8-4d31-b39e-caf8bbfd3b2c {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:13:57 user nova-compute[74646]: WARNING nova.compute.manager [req-b7e4dc24-316f-40bd-b91b-0ee74a0fde3d req-175abd65-c4f0-4f04-8002-bf8243778ebb service nova] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Received unexpected event network-vif-plugged-17add16e-23d8-4d31-b39e-caf8bbfd3b2c for instance with vm_state active and task_state deleting.
Oct 26 16:13:58 user nova-compute[74646]: INFO nova.compute.manager [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 363a4854-229c-482c-9235-3bfa9a639519] Took 1.04 seconds to detach 1 volumes for instance.
Oct 26 16:13:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:13:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:13:58 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:13:58 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:13:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:13:58 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Deleted allocations for instance 363a4854-229c-482c-9235-3bfa9a639519
Oct 26 16:13:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-15c7c4eb-bfcb-4013-9e74-bd5f13beb240 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "363a4854-229c-482c-9235-3bfa9a639519" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.532s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:14:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:16 user nova-compute[74646]: INFO nova.compute.manager [None req-48e9440d-359c-487c-a2da-07b4635989cc tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Unrescuing
Oct 26 16:14:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-48e9440d-359c-487c-a2da-07b4635989cc tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "refresh_cache-f70f8714-4267-481f-bf97-e0afe03668a9" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:14:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-48e9440d-359c-487c-a2da-07b4635989cc tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquired lock "refresh_cache-f70f8714-4267-481f-bf97-e0afe03668a9" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:14:16 user nova-compute[74646]: DEBUG nova.network.neutron [None req-48e9440d-359c-487c-a2da-07b4635989cc tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:14:17 user nova-compute[74646]: DEBUG nova.network.neutron [None req-48e9440d-359c-487c-a2da-07b4635989cc tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Updating instance_info_cache with network_info: [{"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:14:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-48e9440d-359c-487c-a2da-07b4635989cc tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Releasing lock "refresh_cache-f70f8714-4267-481f-bf97-e0afe03668a9" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:14:17 user nova-compute[74646]: DEBUG nova.objects.instance [None req-48e9440d-359c-487c-a2da-07b4635989cc tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'flavor' on Instance uuid f70f8714-4267-481f-bf97-e0afe03668a9 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:14:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-05e5dce0-d61d-4ad3-bb70-ab11a6d41cbd req-3b14f9b9-bcad-4c1c-8d02-3c1f27603742 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-vif-unplugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:14:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-05e5dce0-d61d-4ad3-bb70-ab11a6d41cbd req-3b14f9b9-bcad-4c1c-8d02-3c1f27603742 service nova] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-05e5dce0-d61d-4ad3-bb70-ab11a6d41cbd req-3b14f9b9-bcad-4c1c-8d02-3c1f27603742 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-05e5dce0-d61d-4ad3-bb70-ab11a6d41cbd req-3b14f9b9-bcad-4c1c-8d02-3c1f27603742 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-05e5dce0-d61d-4ad3-bb70-ab11a6d41cbd req-3b14f9b9-bcad-4c1c-8d02-3c1f27603742 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] No waiting events found dispatching network-vif-unplugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:14:17 user nova-compute[74646]: WARNING nova.compute.manager [req-05e5dce0-d61d-4ad3-bb70-ab11a6d41cbd req-3b14f9b9-bcad-4c1c-8d02-3c1f27603742 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received unexpected event network-vif-unplugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 for instance with vm_state rescued and task_state unrescuing.
Oct 26 16:14:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:18 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Instance destroyed successfully.
Oct 26 16:14:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-d4723c63-9827-4e5a-b783-8862a7c56b07 req-cb3e9886-20a9-48fc-ab42-f134287cbb2f service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d4723c63-9827-4e5a-b783-8862a7c56b07 req-cb3e9886-20a9-48fc-ab42-f134287cbb2f service nova] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d4723c63-9827-4e5a-b783-8862a7c56b07 req-cb3e9886-20a9-48fc-ab42-f134287cbb2f service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d4723c63-9827-4e5a-b783-8862a7c56b07 req-cb3e9886-20a9-48fc-ab42-f134287cbb2f service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-d4723c63-9827-4e5a-b783-8862a7c56b07 req-cb3e9886-20a9-48fc-ab42-f134287cbb2f service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] No waiting events found dispatching network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:14:19 user nova-compute[74646]: WARNING nova.compute.manager [req-d4723c63-9827-4e5a-b783-8862a7c56b07 req-cb3e9886-20a9-48fc-ab42-f134287cbb2f service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received unexpected event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 for instance with vm_state rescued and task_state unrescuing.
Oct 26 16:14:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-d4723c63-9827-4e5a-b783-8862a7c56b07 req-cb3e9886-20a9-48fc-ab42-f134287cbb2f service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d4723c63-9827-4e5a-b783-8862a7c56b07 req-cb3e9886-20a9-48fc-ab42-f134287cbb2f service nova] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d4723c63-9827-4e5a-b783-8862a7c56b07 req-cb3e9886-20a9-48fc-ab42-f134287cbb2f service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-d4723c63-9827-4e5a-b783-8862a7c56b07 req-cb3e9886-20a9-48fc-ab42-f134287cbb2f service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-d4723c63-9827-4e5a-b783-8862a7c56b07 req-cb3e9886-20a9-48fc-ab42-f134287cbb2f service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] No waiting events found dispatching network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:14:19 user nova-compute[74646]: WARNING nova.compute.manager [req-d4723c63-9827-4e5a-b783-8862a7c56b07 req-cb3e9886-20a9-48fc-ab42-f134287cbb2f service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received unexpected event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 for instance with vm_state rescued and task_state unrescuing.
Oct 26 16:14:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-48e9440d-359c-487c-a2da-07b4635989cc tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:14:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-1a4a430a-87b3-4683-aa7b-d5f8cb7eaec8 req-f0fd5532-3740-40b2-8547-e262aa38ec54 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:14:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1a4a430a-87b3-4683-aa7b-d5f8cb7eaec8 req-f0fd5532-3740-40b2-8547-e262aa38ec54 service nova] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1a4a430a-87b3-4683-aa7b-d5f8cb7eaec8 req-f0fd5532-3740-40b2-8547-e262aa38ec54 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1a4a430a-87b3-4683-aa7b-d5f8cb7eaec8 req-f0fd5532-3740-40b2-8547-e262aa38ec54 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-1a4a430a-87b3-4683-aa7b-d5f8cb7eaec8 req-f0fd5532-3740-40b2-8547-e262aa38ec54 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] No waiting events found dispatching network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:14:21 user nova-compute[74646]: WARNING nova.compute.manager [req-1a4a430a-87b3-4683-aa7b-d5f8cb7eaec8 req-f0fd5532-3740-40b2-8547-e262aa38ec54 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received unexpected event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 for instance with vm_state active and task_state None.
Oct 26 16:14:22 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:14:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Cleaning up deleted instances {{(pid=74646) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 16:14:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] There are 0 instances to clean {{(pid=74646) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 16:14:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:14:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 16:14:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:14:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:14:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:32 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:14:32 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:14:32 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Cleaning up deleted instances with incomplete migration  {{(pid=74646) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 16:14:33 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:14:35 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:14:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:14:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Rebuilding the list of instances to heal {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 16:14:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:14:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:14:35 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:14:35 user nova-compute[74646]: DEBUG nova.objects.instance [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lazy-loading 'info_cache' on Instance uuid 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:14:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:35 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updating instance_info_cache with network_info: [{"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:14:35 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:14:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:14:35 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:14:35 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:14:36 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:14:36 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:14:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:36 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:14:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:36 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:14:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:36 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:37 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:14:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:37 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:38 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:14:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:38 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:14:38 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:14:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8225MB free_disk=25.02727508544922GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:14:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 511f84be-7779-4856-8611-9171c1b59d58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance f70f8714-4267-481f-bf97-e0afe03668a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2bc4a961-4a5f-4477-8603-823adb496736 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance eae356d7-073d-434c-abad-74c56205d364 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing inventories for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Updating ProviderTree inventory for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Updating inventory in ProviderTree for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing aggregate associations for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6, aggregates: None {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing trait associations for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:14:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.555s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:14:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:14:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:42 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:14:43 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:14:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:46 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:14:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "dd13d851-9338-4811-b48f-06c719844358" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "dd13d851-9338-4811-b48f-06c719844358" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:14:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:14:46 user nova-compute[74646]: INFO nova.compute.claims [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Claim successful on node user
Oct 26 16:14:47 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:14:47 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:14:47 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG nova.policy [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9419f9603ca647269ed1cf42e233507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a984c8da90ff476191cd5aa5787032c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:14:47 user nova-compute[74646]: INFO nova.virt.block_device [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Booting with volume f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 at /dev/vda
Oct 26 16:14:47 user nova-compute[74646]: DEBUG os_brick.utils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9143c6c-ee13-4f95-9396-5eb3d48f590f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79ef056-bcef-4d66-9984-7a6feb6ce153]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a59845-9e33-4bca-b1a2-a00cc3f61055]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[98512767-8ed2-4e6b-b319-378bbad90d84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:14:47 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:14:47 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c3a4a5-54e4-4619-8d82-1f55e1c97637]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG os_brick.utils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Updating existing volume attachment record: d783d800-3fd0-47a9-8f8f-64b3fe189396 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:14:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Successfully created port: a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:14:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Successfully updated port: a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:14:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:14:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquired lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:14:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:14:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-7cf4674f-bcaa-466a-a10a-1e30c0f81be7 req-53197fa2-063b-4731-b708-f211009a0d6f service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Received event network-changed-a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:14:48 user nova-compute[74646]: DEBUG nova.compute.manager [req-7cf4674f-bcaa-466a-a10a-1e30c0f81be7 req-53197fa2-063b-4731-b708-f211009a0d6f service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Refreshing instance network info cache due to event network-changed-a3d137ce-6a6c-4f92-98fd-c4752d199e3c. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:14:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7cf4674f-bcaa-466a-a10a-1e30c0f81be7 req-53197fa2-063b-4731-b708-f211009a0d6f service nova] Acquiring lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:14:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG nova.network.neutron [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Updating instance_info_cache with network_info: [{"id": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "address": "fa:16:3e:1b:eb:e2", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d137ce-6a", "ovs_interfaceid": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Releasing lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Instance network_info: |[{"id": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "address": "fa:16:3e:1b:eb:e2", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d137ce-6a", "ovs_interfaceid": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7cf4674f-bcaa-466a-a10a-1e30c0f81be7 req-53197fa2-063b-4731-b708-f211009a0d6f service nova] Acquired lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG nova.network.neutron [req-7cf4674f-bcaa-466a-a10a-1e30c0f81be7 req-53197fa2-063b-4731-b708-f211009a0d6f service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Refreshing network info cache for port a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG nova.network.neutron [req-7cf4674f-bcaa-466a-a10a-1e30c0f81be7 req-53197fa2-063b-4731-b708-f211009a0d6f service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Updated VIF entry in instance network info cache for port a3d137ce-6a6c-4f92-98fd-c4752d199e3c. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG nova.network.neutron [req-7cf4674f-bcaa-466a-a10a-1e30c0f81be7 req-53197fa2-063b-4731-b708-f211009a0d6f service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Updating instance_info_cache with network_info: [{"id": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "address": "fa:16:3e:1b:eb:e2", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d137ce-6a", "ovs_interfaceid": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-7cf4674f-bcaa-466a-a10a-1e30c0f81be7 req-53197fa2-063b-4731-b708-f211009a0d6f service nova] Releasing lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:49 user nova-compute[74646]: INFO nova.compute.manager [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Terminating instance
Oct 26 16:14:49 user nova-compute[74646]: DEBUG nova.compute.manager [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-cd8c0541-93c2-45d7-b180-cafbd862e455 req-58be9d01-37f1-479b-9c85-5e8cb54aac98 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received event network-vif-unplugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cd8c0541-93c2-45d7-b180-cafbd862e455 req-58be9d01-37f1-479b-9c85-5e8cb54aac98 service nova] Acquiring lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cd8c0541-93c2-45d7-b180-cafbd862e455 req-58be9d01-37f1-479b-9c85-5e8cb54aac98 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cd8c0541-93c2-45d7-b180-cafbd862e455 req-58be9d01-37f1-479b-9c85-5e8cb54aac98 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-cd8c0541-93c2-45d7-b180-cafbd862e455 req-58be9d01-37f1-479b-9c85-5e8cb54aac98 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] No waiting events found dispatching network-vif-unplugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-cd8c0541-93c2-45d7-b180-cafbd862e455 req-58be9d01-37f1-479b-9c85-5e8cb54aac98 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received event network-vif-unplugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Instance destroyed successfully.
Oct 26 16:14:50 user nova-compute[74646]: DEBUG nova.objects.instance [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lazy-loading 'resources' on Instance uuid 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:54:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1900340032',display_name='tempest-ServerActionsTestOtherA-server-1900340032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1900340032',id=13,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAFpQMuDQ9yV5cYwbhkTyRLOjZZ0Tl/sjjENeyylssja83c6EpW+JftZQ9mXXtyfrIqGGnek7tn477+zNOt3iNR5IPo2YdOD8TzgfFC3ul9nIufuOchmOZ60R0hjnHQdyg==',key_name='tempest-keypair-1269718539',keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:54:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6c8788e95cc244f98b0ff8d593d1e067',ramdisk_id='',reservation_id='r-70neg647',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-333958340',owner_user_name='tempest-ServerActionsTestOtherA-333958340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T15:54:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9311cee7c04e45ddbae6f16ba43eed2e',uuid=9f40ed75-7cf2-4f13-95cb-5d23c8ce8497,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converting VIF {"id": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "address": "fa:16:3e:6c:ec:35", "network": {"id": "f3c7b3ca-ebfa-45a5-9c89-02103702e3b2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1749591084-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6c8788e95cc244f98b0ff8d593d1e067", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapade5aae8-ed", "ovs_interfaceid": "ade5aae8-edfd-4f46-b943-e261afcc76f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6c:ec:35,bridge_name='br-int',has_traffic_filtering=True,id=ade5aae8-edfd-4f46-b943-e261afcc76f0,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade5aae8-ed') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG os_vif [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:ec:35,bridge_name='br-int',has_traffic_filtering=True,id=ade5aae8-edfd-4f46-b943-e261afcc76f0,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade5aae8-ed') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapade5aae8-ed, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7ac4ad6-a361-474d-852f-6c1968a46931) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:50 user nova-compute[74646]: INFO os_vif [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6c:ec:35,bridge_name='br-int',has_traffic_filtering=True,id=ade5aae8-edfd-4f46-b943-e261afcc76f0,network=Network(f3c7b3ca-ebfa-45a5-9c89-02103702e3b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapade5aae8-ed')
Oct 26 16:14:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Deleting instance files /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497_del
Oct 26 16:14:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Deletion of /opt/stack/data/nova/instances/9f40ed75-7cf2-4f13-95cb-5d23c8ce8497_del complete
Oct 26 16:14:50 user nova-compute[74646]: INFO nova.compute.manager [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 26 16:14:50 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:14:50 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:14:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:51 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:14:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:14:51 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Took 0.79 seconds to deallocate network for instance.
Oct 26 16:14:51 user nova-compute[74646]: DEBUG nova.compute.manager [req-f0259e58-bd58-4e57-8ad0-3e046f412bd0 req-980f2637-7f27-4599-ad38-8c9101482df3 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received event network-vif-deleted-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:14:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:51 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:14:51 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.445s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:52 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Deleted allocations for instance 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497
Oct 26 16:14:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received event network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Acquiring lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] No waiting events found dispatching network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:14:52 user nova-compute[74646]: WARNING nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received unexpected event network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 for instance with vm_state deleted and task_state None.
Oct 26 16:14:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received event network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Acquiring lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] No waiting events found dispatching network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:14:52 user nova-compute[74646]: WARNING nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received unexpected event network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 for instance with vm_state deleted and task_state None.
Oct 26 16:14:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received event network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Acquiring lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] No waiting events found dispatching network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:14:52 user nova-compute[74646]: WARNING nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received unexpected event network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 for instance with vm_state deleted and task_state None.
Oct 26 16:14:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received event network-vif-unplugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Acquiring lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] No waiting events found dispatching network-vif-unplugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:14:52 user nova-compute[74646]: WARNING nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received unexpected event network-vif-unplugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 for instance with vm_state deleted and task_state None.
Oct 26 16:14:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received event network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Acquiring lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] No waiting events found dispatching network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:14:52 user nova-compute[74646]: WARNING nova.compute.manager [req-cee4b125-01b2-417c-8e6c-2bc4cda4e111 req-a8b411d9-7c85-472e-9cca-e3883f982b99 service nova] [instance: 9f40ed75-7cf2-4f13-95cb-5d23c8ce8497] Received unexpected event network-vif-plugged-ade5aae8-edfd-4f46-b943-e261afcc76f0 for instance with vm_state deleted and task_state None.
Oct 26 16:14:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-beb1b0a1-e25e-4d37-87cc-9efee3a372d8 tempest-ServerActionsTestOtherA-333958340 tempest-ServerActionsTestOtherA-333958340-project-member] Lock "9f40ed75-7cf2-4f13-95cb-5d23c8ce8497" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.456s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:14:54 user nova-compute[74646]: INFO nova.compute.manager [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Unshelving
Oct 26 16:14:54 user nova-compute[74646]: INFO nova.virt.block_device [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Booting with volume 55cab237-57fe-4ecb-aba7-a1827f4ecdbe at /dev/vda
Oct 26 16:14:54 user nova-compute[74646]: DEBUG os_brick.utils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96bb650-68d9-4907-a78c-759fcdf8cc78]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc47b72-25b7-470f-ab46-42a6090c6730]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f76d5e-d8b8-4610-b33b-644257f7a754]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a23de1-f473-47c3-a3f2-0f23716d37d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:14:54 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:14:54 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[64734eb3-3243-4795-bb60-cfeab862a705]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG os_brick.utils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:14:54 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updating existing volume attachment record: 1492fdd6-5819-4fa0-90e8-ce12cc40bca8 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:14:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:15:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:15:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 16:15:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:15:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:15:05 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:15:06 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Creating image(s)
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Ensure instance console log exists: /opt/stack/data/nova/instances/dd13d851-9338-4811-b48f-06c719844358/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Start _get_guest_xml network_info=[{"id": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "address": "fa:16:3e:1b:eb:e2", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d137ce-6a", "ovs_interfaceid": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'd783d800-3fd0-47a9-8f8f-64b3fe189396', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocESsuLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dd13d851-9338-4811-b48f-06c719844358', 'attached_at': '', 'detached_at': '', 'volume_id': 'f37b06a8-2fb2-47e1-b42b-9223a5f9dd89', 'serial': 'f37b06a8-2fb2-47e1-b42b-9223a5f9dd89'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:15:06 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:15:06 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocESsuLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:15:06 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:15:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:15:06 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:15:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:15:06 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef55620-4d61-4f98-ad69-3e8fefcf70ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:15:06 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afdd1d6-78fe-4a67-aaff-0b2fa158af4b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89] added
Oct 26 16:15:06 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0bd721-125c-4e0d-a21b-3f1a48e9f714]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f9bc20-4e1c-4498-b364-3efe7075f6b0]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ocESsuLr {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ocESsuLr" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d3127a-34c9-45a1-8de8-097931c62d20]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ocESsuLr'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a3dd69-ba71-462e-94df-0e2bfa384d44]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[aca84217-17da-4df6-b02f-571e054c2b3c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:15:06 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:15:06 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:15:06 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:15:06 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:15:06 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:15:06 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a8a0937-8e30-4785-b59d-0832ebd902b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260]
Oct 26 16:15:06 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260] successful.
Oct 26 16:15:06 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:06 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3917f97d-803f-4c41-91ff-3ea355ce0d4c]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ac4d40-2781-478c-93e7-d3e604ced1a1]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:15:07 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:15:07 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:15:07 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:15:07 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:15:07 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:15:07 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:15:07 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:15:07 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[96bf75f4-88fa-4b43-a6b7-5a89c308426d]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:15:07 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocESsuLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== connect_volume: return (1316ms) {'type': 'block', 'scsi_wwn': '23261366663323962', 'path': '/dev/sdc'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23261366663323962', 'path': '/dev/sdc'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-123124849',display_name='tempest-TestVolumeBootPattern-server-123124849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-123124849',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcrhPEoRoaB0ki3RmOaZ3eTquho7+8b0QqO8Voy8+ev28RwRqncTnJ8yqJ/AeeNTkufE9hPbEWGpSzdo215+QWyfPE53vOWOtQaI8OQeut+svp088xcotWDN6W4cNUpMQ==',key_name='tempest-TestVolumeBootPattern-371467899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-4j0qkpar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:14:47Z,user_data=None,user_id='9419f9603ca647269ed1cf42e233507f',uuid=dd13d851-9338-4811-b48f-06c719844358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "address": "fa:16:3e:1b:eb:e2", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d137ce-6a", "ovs_interfaceid": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "address": "fa:16:3e:1b:eb:e2", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d137ce-6a", "ovs_interfaceid": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=a3d137ce-6a6c-4f92-98fd-c4752d199e3c,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3d137ce-6a') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG nova.objects.instance [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lazy-loading 'pci_devices' on Instance uuid dd13d851-9338-4811-b48f-06c719844358 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:15:08 user nova-compute[74646]:   <uuid>dd13d851-9338-4811-b48f-06c719844358</uuid>
Oct 26 16:15:08 user nova-compute[74646]:   <name>instance-00000028</name>
Oct 26 16:15:08 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:15:08 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:15:08 user nova-compute[74646]:   <metadata>
Oct 26 16:15:08 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:15:08 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:15:08 user nova-compute[74646]:       <nova:name>tempest-TestVolumeBootPattern-server-123124849</nova:name>
Oct 26 16:15:08 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:15:06</nova:creationTime>
Oct 26 16:15:08 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:15:08 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:15:08 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:15:08 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:15:08 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:15:08 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:15:08 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:15:08 user nova-compute[74646]:       <nova:owner>
Oct 26 16:15:08 user nova-compute[74646]:         <nova:user uuid="9419f9603ca647269ed1cf42e233507f">tempest-TestVolumeBootPattern-1231840017-project-member</nova:user>
Oct 26 16:15:08 user nova-compute[74646]:         <nova:project uuid="a984c8da90ff476191cd5aa5787032c1">tempest-TestVolumeBootPattern-1231840017</nova:project>
Oct 26 16:15:08 user nova-compute[74646]:       </nova:owner>
Oct 26 16:15:08 user nova-compute[74646]:       <nova:ports>
Oct 26 16:15:08 user nova-compute[74646]:         <nova:port uuid="a3d137ce-6a6c-4f92-98fd-c4752d199e3c">
Oct 26 16:15:08 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 26 16:15:08 user nova-compute[74646]:         </nova:port>
Oct 26 16:15:08 user nova-compute[74646]:       </nova:ports>
Oct 26 16:15:08 user nova-compute[74646]:     </nova:instance>
Oct 26 16:15:08 user nova-compute[74646]:   </metadata>
Oct 26 16:15:08 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:15:08 user nova-compute[74646]:     <system>
Oct 26 16:15:08 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:15:08 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:15:08 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:15:08 user nova-compute[74646]:       <entry name="serial">dd13d851-9338-4811-b48f-06c719844358</entry>
Oct 26 16:15:08 user nova-compute[74646]:       <entry name="uuid">dd13d851-9338-4811-b48f-06c719844358</entry>
Oct 26 16:15:08 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:15:08 user nova-compute[74646]:     </system>
Oct 26 16:15:08 user nova-compute[74646]:   </sysinfo>
Oct 26 16:15:08 user nova-compute[74646]:   <os>
Oct 26 16:15:08 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:15:08 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:15:08 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:15:08 user nova-compute[74646]:   </os>
Oct 26 16:15:08 user nova-compute[74646]:   <features>
Oct 26 16:15:08 user nova-compute[74646]:     <acpi/>
Oct 26 16:15:08 user nova-compute[74646]:     <apic/>
Oct 26 16:15:08 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:15:08 user nova-compute[74646]:   </features>
Oct 26 16:15:08 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:15:08 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:15:08 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:15:08 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:15:08 user nova-compute[74646]:   </clock>
Oct 26 16:15:08 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:15:08 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:15:08 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:15:08 user nova-compute[74646]:   </cpu>
Oct 26 16:15:08 user nova-compute[74646]:   <devices>
Oct 26 16:15:08 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:15:08 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:15:08 user nova-compute[74646]:       <source dev="/dev/sdc"/>
Oct 26 16:15:08 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:15:08 user nova-compute[74646]:       <serial>f37b06a8-2fb2-47e1-b42b-9223a5f9dd89</serial>
Oct 26 16:15:08 user nova-compute[74646]:     </disk>
Oct 26 16:15:08 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:15:08 user nova-compute[74646]:       <mac address="fa:16:3e:1b:eb:e2"/>
Oct 26 16:15:08 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:15:08 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:15:08 user nova-compute[74646]:       <target dev="tapa3d137ce-6a"/>
Oct 26 16:15:08 user nova-compute[74646]:     </interface>
Oct 26 16:15:08 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:15:08 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/dd13d851-9338-4811-b48f-06c719844358/console.log" append="off"/>
Oct 26 16:15:08 user nova-compute[74646]:     </serial>
Oct 26 16:15:08 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:15:08 user nova-compute[74646]:     <video>
Oct 26 16:15:08 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:15:08 user nova-compute[74646]:     </video>
Oct 26 16:15:08 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:15:08 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:15:08 user nova-compute[74646]:     </rng>
Oct 26 16:15:08 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:15:08 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:15:08 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:15:08 user nova-compute[74646]:     </memballoon>
Oct 26 16:15:08 user nova-compute[74646]:   </devices>
Oct 26 16:15:08 user nova-compute[74646]: </domain>
Oct 26 16:15:08 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-123124849',display_name='tempest-TestVolumeBootPattern-server-123124849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-123124849',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcrhPEoRoaB0ki3RmOaZ3eTquho7+8b0QqO8Voy8+ev28RwRqncTnJ8yqJ/AeeNTkufE9hPbEWGpSzdo215+QWyfPE53vOWOtQaI8OQeut+svp088xcotWDN6W4cNUpMQ==',key_name='tempest-TestVolumeBootPattern-371467899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-4j0qkpar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:14:47Z,user_data=None,user_id='9419f9603ca647269ed1cf42e233507f',uuid=dd13d851-9338-4811-b48f-06c719844358,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "address": "fa:16:3e:1b:eb:e2", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d137ce-6a", "ovs_interfaceid": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "address": "fa:16:3e:1b:eb:e2", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d137ce-6a", "ovs_interfaceid": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=a3d137ce-6a6c-4f92-98fd-c4752d199e3c,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3d137ce-6a') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG os_vif [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=a3d137ce-6a6c-4f92-98fd-c4752d199e3c,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3d137ce-6a') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ba2a2ea-2a3e-55e3-8870-36062f184133', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3d137ce-6a, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3d137ce-6a, col_values=(('qos', UUID('fe2c16e3-df77-46ef-b8b0-50b2b43f3641')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3d137ce-6a, col_values=(('external_ids', {'iface-id': 'a3d137ce-6a6c-4f92-98fd-c4752d199e3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:eb:e2', 'vm-uuid': 'dd13d851-9338-4811-b48f-06c719844358'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:08 user nova-compute[74646]: INFO os_vif [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=a3d137ce-6a6c-4f92-98fd-c4752d199e3c,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3d137ce-6a')
Oct 26 16:15:08 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:15:08 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] No VIF found with MAC fa:16:3e:1b:eb:e2, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:15:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:09 user nova-compute[74646]: DEBUG nova.compute.manager [req-b8e79f42-8049-464b-a4d9-e3a781369489 req-f2ff0a0c-d357-4fd6-8418-15c6eb7139e4 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Received event network-vif-plugged-a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:15:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b8e79f42-8049-464b-a4d9-e3a781369489 req-f2ff0a0c-d357-4fd6-8418-15c6eb7139e4 service nova] Acquiring lock "dd13d851-9338-4811-b48f-06c719844358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b8e79f42-8049-464b-a4d9-e3a781369489 req-f2ff0a0c-d357-4fd6-8418-15c6eb7139e4 service nova] Lock "dd13d851-9338-4811-b48f-06c719844358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b8e79f42-8049-464b-a4d9-e3a781369489 req-f2ff0a0c-d357-4fd6-8418-15c6eb7139e4 service nova] Lock "dd13d851-9338-4811-b48f-06c719844358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:09 user nova-compute[74646]: DEBUG nova.compute.manager [req-b8e79f42-8049-464b-a4d9-e3a781369489 req-f2ff0a0c-d357-4fd6-8418-15c6eb7139e4 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] No waiting events found dispatching network-vif-plugged-a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:15:09 user nova-compute[74646]: WARNING nova.compute.manager [req-b8e79f42-8049-464b-a4d9-e3a781369489 req-f2ff0a0c-d357-4fd6-8418-15c6eb7139e4 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Received unexpected event network-vif-plugged-a3d137ce-6a6c-4f92-98fd-c4752d199e3c for instance with vm_state building and task_state spawning.
Oct 26 16:15:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:15:11 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: dd13d851-9338-4811-b48f-06c719844358] Instance spawned successfully.
Oct 26 16:15:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:15:11 user nova-compute[74646]: INFO nova.compute.manager [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Took 4.96 seconds to spawn the instance on the hypervisor.
Oct 26 16:15:11 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG nova.compute.manager [req-576d9577-6147-4e78-a5c2-c3dbd78e83af req-b4a65a56-dc33-42c7-9bb4-e0070cf68662 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Received event network-vif-plugged-a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-576d9577-6147-4e78-a5c2-c3dbd78e83af req-b4a65a56-dc33-42c7-9bb4-e0070cf68662 service nova] Acquiring lock "dd13d851-9338-4811-b48f-06c719844358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-576d9577-6147-4e78-a5c2-c3dbd78e83af req-b4a65a56-dc33-42c7-9bb4-e0070cf68662 service nova] Lock "dd13d851-9338-4811-b48f-06c719844358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-576d9577-6147-4e78-a5c2-c3dbd78e83af req-b4a65a56-dc33-42c7-9bb4-e0070cf68662 service nova] Lock "dd13d851-9338-4811-b48f-06c719844358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG nova.compute.manager [req-576d9577-6147-4e78-a5c2-c3dbd78e83af req-b4a65a56-dc33-42c7-9bb4-e0070cf68662 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] No waiting events found dispatching network-vif-plugged-a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:15:11 user nova-compute[74646]: WARNING nova.compute.manager [req-576d9577-6147-4e78-a5c2-c3dbd78e83af req-b4a65a56-dc33-42c7-9bb4-e0070cf68662 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Received unexpected event network-vif-plugged-a3d137ce-6a6c-4f92-98fd-c4752d199e3c for instance with vm_state building and task_state spawning.
Oct 26 16:15:11 user nova-compute[74646]: INFO nova.compute.manager [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Took 24.93 seconds to build instance.
Oct 26 16:15:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0ed584e6-5210-4f2c-b3aa-b84d1a04197a tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "dd13d851-9338-4811-b48f-06c719844358" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 25.044s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:11 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:15:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:12 user nova-compute[74646]: DEBUG nova.objects.instance [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lazy-loading 'pci_requests' on Instance uuid 508f43f1-6d5c-41ed-9e4f-06eec0bc992e {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:15:13 user nova-compute[74646]: DEBUG nova.objects.instance [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lazy-loading 'numa_topology' on Instance uuid 508f43f1-6d5c-41ed-9e4f-06eec0bc992e {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:15:13 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:15:13 user nova-compute[74646]: INFO nova.compute.claims [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Claim successful on node user
Oct 26 16:15:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:13 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:15:13 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:15:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.370s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:13 user nova-compute[74646]: INFO nova.network.neutron [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updating port c86c4c00-d0ce-47d4-94d0-bf17114750a4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 26 16:15:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:15:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquired lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:15:13 user nova-compute[74646]: DEBUG nova.network.neutron [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.compute.manager [req-a49abae2-103d-4ed5-851e-9eab08a7231d req-bab7c6ce-1371-40e3-8402-ca90dc617e80 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-changed-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.compute.manager [req-a49abae2-103d-4ed5-851e-9eab08a7231d req-bab7c6ce-1371-40e3-8402-ca90dc617e80 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Refreshing instance network info cache due to event network-changed-c86c4c00-d0ce-47d4-94d0-bf17114750a4. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a49abae2-103d-4ed5-851e-9eab08a7231d req-bab7c6ce-1371-40e3-8402-ca90dc617e80 service nova] Acquiring lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.network.neutron [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updating instance_info_cache with network_info: [{"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Releasing lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:15:14 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Creating image(s)
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Ensure instance console log exists: /opt/stack/data/nova/instances/508f43f1-6d5c-41ed-9e4f-06eec0bc992e/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Start _get_guest_xml network_info=[{"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '1492fdd6-5819-4fa0-90e8-ce12cc40bca8', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNBOtrTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '508f43f1-6d5c-41ed-9e4f-06eec0bc992e', 'attached_at': '', 'detached_at': '', 'volume_id': '55cab237-57fe-4ecb-aba7-a1827f4ecdbe', 'serial': '55cab237-57fe-4ecb-aba7-a1827f4ecdbe'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a49abae2-103d-4ed5-851e-9eab08a7231d req-bab7c6ce-1371-40e3-8402-ca90dc617e80 service nova] Acquired lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.network.neutron [req-a49abae2-103d-4ed5-851e-9eab08a7231d req-bab7c6ce-1371-40e3-8402-ca90dc617e80 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Refreshing network info cache for port c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:15:14 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:15:14 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.objects.instance [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lazy-loading 'vcpu_model' on Instance uuid 508f43f1-6d5c-41ed-9e4f-06eec0bc992e {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.objects.base [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Object Instance<508f43f1-6d5c-41ed-9e4f-06eec0bc992e> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNBOtrTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:15:14 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:15:14 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:15:14 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f1e5fd-ed41-4ce5-b5b3-0474bbcf31e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:15:14 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[739d492b-aaef-4f4c-adea-c7e67bca40a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe] added
Oct 26 16:15:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f110eaa-40e0-4b0b-b428-ca4d800d00a8]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab5f15a-195b-4716-996c-b5e123ccc653]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNBOtrTU {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iNBOtrTU" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[46925275-0e79-4477-990f-7504604e1548]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iNBOtrTU'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ae790b-2c15-4603-82d6-747679f7d875]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[77651622-0356-486b-ab35-c764fbf9817b]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:15:14 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:15:14 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:15:14 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:15:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:15:14 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:15:14 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:15:14 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:15:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[157055cd-d7a7-49ec-b2c7-1fd39ec4d315]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260]
Oct 26 16:15:14 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260] successful.
Oct 26 16:15:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[845f633c-1fe9-490c-af8c-5c566be45f86]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8152f66a-73b1-497d-82f9-40c16fbea06c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:15:14 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:15:14 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:15:14 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:15:14 user nova-compute[74646]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:15:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:15:14 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:15:14 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:15:14 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:15:14 user nova-compute[74646]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:15:14 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] HCTL ('37', '-', '-', 0) found on session 47 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e06d40-abc2-4661-a5db-18834e5592fe]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Searching for a device in session 47 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNBOtrTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.network.neutron [req-a49abae2-103d-4ed5-851e-9eab08a7231d req-bab7c6ce-1371-40e3-8402-ca90dc617e80 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updated VIF entry in instance network info cache for port c86c4c00-d0ce-47d4-94d0-bf17114750a4. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG nova.network.neutron [req-a49abae2-103d-4ed5-851e-9eab08a7231d req-bab7c6ce-1371-40e3-8402-ca90dc617e80 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updating instance_info_cache with network_info: [{"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:15:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a49abae2-103d-4ed5-851e-9eab08a7231d req-bab7c6ce-1371-40e3-8402-ca90dc617e80 service nova] Releasing lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23464623731363734', 'path': '/dev/sdf'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464623731363734', 'path': '/dev/sdf'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T16:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1418828722',display_name='tempest-TestShelveInstance-server-1418828722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1418828722',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1854031540',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:11:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7d6af06081e14055b3b812f706d5ef20',ramdisk_id='',reservation_id='r-g1u9k9d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-48608582',owner_user_name='tempest-TestShelveInstance-48608582-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:14:54Z,user_data=None,user_id='35ad85c745c94ba983e147c8dd2dcbc2',uuid=508f43f1-6d5c-41ed-9e4f-06eec0bc992e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Converting VIF {"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:2f:b6,bridge_name='br-int',has_traffic_filtering=True,id=c86c4c00-d0ce-47d4-94d0-bf17114750a4,network=Network(841be5f4-a63c-4f93-aa53-42702b4ccd16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86c4c00-d0') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG nova.objects.instance [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lazy-loading 'pci_devices' on Instance uuid 508f43f1-6d5c-41ed-9e4f-06eec0bc992e {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG nova.objects.base [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Object Instance<508f43f1-6d5c-41ed-9e4f-06eec0bc992e> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74646) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:15:15 user nova-compute[74646]:   <uuid>508f43f1-6d5c-41ed-9e4f-06eec0bc992e</uuid>
Oct 26 16:15:15 user nova-compute[74646]:   <name>instance-00000024</name>
Oct 26 16:15:15 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:15:15 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:15:15 user nova-compute[74646]:   <metadata>
Oct 26 16:15:15 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:15:15 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:15:15 user nova-compute[74646]:       <nova:name>tempest-TestShelveInstance-server-1418828722</nova:name>
Oct 26 16:15:15 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:15:14</nova:creationTime>
Oct 26 16:15:15 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:15:15 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:15:15 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:15:15 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:15:15 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:15:15 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:15:15 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:15:15 user nova-compute[74646]:       <nova:owner>
Oct 26 16:15:15 user nova-compute[74646]:         <nova:user uuid="35ad85c745c94ba983e147c8dd2dcbc2">tempest-TestShelveInstance-48608582-project-member</nova:user>
Oct 26 16:15:15 user nova-compute[74646]:         <nova:project uuid="7d6af06081e14055b3b812f706d5ef20">tempest-TestShelveInstance-48608582</nova:project>
Oct 26 16:15:15 user nova-compute[74646]:       </nova:owner>
Oct 26 16:15:15 user nova-compute[74646]:       <nova:ports>
Oct 26 16:15:15 user nova-compute[74646]:         <nova:port uuid="c86c4c00-d0ce-47d4-94d0-bf17114750a4">
Oct 26 16:15:15 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 26 16:15:15 user nova-compute[74646]:         </nova:port>
Oct 26 16:15:15 user nova-compute[74646]:       </nova:ports>
Oct 26 16:15:15 user nova-compute[74646]:     </nova:instance>
Oct 26 16:15:15 user nova-compute[74646]:   </metadata>
Oct 26 16:15:15 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:15:15 user nova-compute[74646]:     <system>
Oct 26 16:15:15 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:15:15 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:15:15 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:15:15 user nova-compute[74646]:       <entry name="serial">508f43f1-6d5c-41ed-9e4f-06eec0bc992e</entry>
Oct 26 16:15:15 user nova-compute[74646]:       <entry name="uuid">508f43f1-6d5c-41ed-9e4f-06eec0bc992e</entry>
Oct 26 16:15:15 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:15:15 user nova-compute[74646]:     </system>
Oct 26 16:15:15 user nova-compute[74646]:   </sysinfo>
Oct 26 16:15:15 user nova-compute[74646]:   <os>
Oct 26 16:15:15 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:15:15 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:15:15 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:15:15 user nova-compute[74646]:   </os>
Oct 26 16:15:15 user nova-compute[74646]:   <features>
Oct 26 16:15:15 user nova-compute[74646]:     <acpi/>
Oct 26 16:15:15 user nova-compute[74646]:     <apic/>
Oct 26 16:15:15 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:15:15 user nova-compute[74646]:   </features>
Oct 26 16:15:15 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:15:15 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:15:15 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:15:15 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:15:15 user nova-compute[74646]:   </clock>
Oct 26 16:15:15 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:15:15 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:15:15 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:15:15 user nova-compute[74646]:   </cpu>
Oct 26 16:15:15 user nova-compute[74646]:   <devices>
Oct 26 16:15:15 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:15:15 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:15:15 user nova-compute[74646]:       <source dev="/dev/sdf"/>
Oct 26 16:15:15 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:15:15 user nova-compute[74646]:       <serial>55cab237-57fe-4ecb-aba7-a1827f4ecdbe</serial>
Oct 26 16:15:15 user nova-compute[74646]:     </disk>
Oct 26 16:15:15 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:15:15 user nova-compute[74646]:       <mac address="fa:16:3e:13:2f:b6"/>
Oct 26 16:15:15 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:15:15 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:15:15 user nova-compute[74646]:       <target dev="tapc86c4c00-d0"/>
Oct 26 16:15:15 user nova-compute[74646]:     </interface>
Oct 26 16:15:15 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:15:15 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/508f43f1-6d5c-41ed-9e4f-06eec0bc992e/console.log" append="off"/>
Oct 26 16:15:15 user nova-compute[74646]:     </serial>
Oct 26 16:15:15 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:15:15 user nova-compute[74646]:     <video>
Oct 26 16:15:15 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:15:15 user nova-compute[74646]:     </video>
Oct 26 16:15:15 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:15:15 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:15:15 user nova-compute[74646]:     </rng>
Oct 26 16:15:15 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:15:15 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:15:15 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:15:15 user nova-compute[74646]:     </memballoon>
Oct 26 16:15:15 user nova-compute[74646]:   </devices>
Oct 26 16:15:15 user nova-compute[74646]: </domain>
Oct 26 16:15:15 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T16:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1418828722',display_name='tempest-TestShelveInstance-server-1418828722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1418828722',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1854031540',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:11:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='7d6af06081e14055b3b812f706d5ef20',ramdisk_id='',reservation_id='r-g1u9k9d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-48608582',owner_user_name='tempest-TestShelveInstance-48608582-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:14:54Z,user_data=None,user_id='35ad85c745c94ba983e147c8dd2dcbc2',uuid=508f43f1-6d5c-41ed-9e4f-06eec0bc992e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Converting VIF {"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:2f:b6,bridge_name='br-int',has_traffic_filtering=True,id=c86c4c00-d0ce-47d4-94d0-bf17114750a4,network=Network(841be5f4-a63c-4f93-aa53-42702b4ccd16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86c4c00-d0') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG os_vif [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:2f:b6,bridge_name='br-int',has_traffic_filtering=True,id=c86c4c00-d0ce-47d4-94d0-bf17114750a4,network=Network(841be5f4-a63c-4f93-aa53-42702b4ccd16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86c4c00-d0') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7f14318d-e9cd-5374-bd46-a8befaa9cb47', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc86c4c00-d0, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc86c4c00-d0, col_values=(('qos', UUID('f6545df2-3faa-4cfb-9709-503bbec6f335')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc86c4c00-d0, col_values=(('external_ids', {'iface-id': 'c86c4c00-d0ce-47d4-94d0-bf17114750a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:2f:b6', 'vm-uuid': '508f43f1-6d5c-41ed-9e4f-06eec0bc992e'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:15:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:15 user nova-compute[74646]: INFO os_vif [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:2f:b6,bridge_name='br-int',has_traffic_filtering=True,id=c86c4c00-d0ce-47d4-94d0-bf17114750a4,network=Network(841be5f4-a63c-4f93-aa53-42702b4ccd16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86c4c00-d0')
Oct 26 16:15:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:15:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] No VIF found with MAC fa:16:3e:13:2f:b6, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:15:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-f0b6e54d-3b36-4f52-9e3d-6dfbf3d2c242 req-19450e46-f6e6-447c-bd95-5459cc3375d8 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:15:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f0b6e54d-3b36-4f52-9e3d-6dfbf3d2c242 req-19450e46-f6e6-447c-bd95-5459cc3375d8 service nova] Acquiring lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f0b6e54d-3b36-4f52-9e3d-6dfbf3d2c242 req-19450e46-f6e6-447c-bd95-5459cc3375d8 service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f0b6e54d-3b36-4f52-9e3d-6dfbf3d2c242 req-19450e46-f6e6-447c-bd95-5459cc3375d8 service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-f0b6e54d-3b36-4f52-9e3d-6dfbf3d2c242 req-19450e46-f6e6-447c-bd95-5459cc3375d8 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] No waiting events found dispatching network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:15:17 user nova-compute[74646]: WARNING nova.compute.manager [req-f0b6e54d-3b36-4f52-9e3d-6dfbf3d2c242 req-19450e46-f6e6-447c-bd95-5459cc3375d8 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received unexpected event network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 26 16:15:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:15:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:15:19 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Instance spawned successfully.
Oct 26 16:15:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:15:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-63bf4987-6faf-466c-9db8-25e0f0ff2941 tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 25.342s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-9d87d815-8c17-45ea-b9b6-ac89b5539e89 req-cc9a5d9c-f788-4c47-9b19-3c4c1076d23a service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:15:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9d87d815-8c17-45ea-b9b6-ac89b5539e89 req-cc9a5d9c-f788-4c47-9b19-3c4c1076d23a service nova] Acquiring lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9d87d815-8c17-45ea-b9b6-ac89b5539e89 req-cc9a5d9c-f788-4c47-9b19-3c4c1076d23a service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-9d87d815-8c17-45ea-b9b6-ac89b5539e89 req-cc9a5d9c-f788-4c47-9b19-3c4c1076d23a service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-9d87d815-8c17-45ea-b9b6-ac89b5539e89 req-cc9a5d9c-f788-4c47-9b19-3c4c1076d23a service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] No waiting events found dispatching network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:15:19 user nova-compute[74646]: WARNING nova.compute.manager [req-9d87d815-8c17-45ea-b9b6-ac89b5539e89 req-cc9a5d9c-f788-4c47-9b19-3c4c1076d23a service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received unexpected event network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 for instance with vm_state active and task_state None.
Oct 26 16:15:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:33 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:15:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:15:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:36 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:15:36 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:15:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:15:36 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:15:36 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1283575f-b614-42d5-b632-c1409f295207] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1283575f-b614-42d5-b632-c1409f295207] Updating instance_info_cache with network_info: [{"id": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "address": "fa:16:3e:1b:cc:e1", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap366498f3-12", "ovs_interfaceid": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1283575f-b614-42d5-b632-c1409f295207] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-564c52ac-0c43-4e4c-8fe9-4f06b3001b75 req-23cf0776-fff0-4e75-bea5-0611b7181922 service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Received event network-changed-7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG nova.compute.manager [req-564c52ac-0c43-4e4c-8fe9-4f06b3001b75 req-23cf0776-fff0-4e75-bea5-0611b7181922 service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Refreshing instance network info cache due to event network-changed-7c80870a-3c7c-4ead-b0ac-e257279721c0. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-564c52ac-0c43-4e4c-8fe9-4f06b3001b75 req-23cf0776-fff0-4e75-bea5-0611b7181922 service nova] Acquiring lock "refresh_cache-eae356d7-073d-434c-abad-74c56205d364" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-564c52ac-0c43-4e4c-8fe9-4f06b3001b75 req-23cf0776-fff0-4e75-bea5-0611b7181922 service nova] Acquired lock "refresh_cache-eae356d7-073d-434c-abad-74c56205d364" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG nova.network.neutron [req-564c52ac-0c43-4e4c-8fe9-4f06b3001b75 req-23cf0776-fff0-4e75-bea5-0611b7181922 service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Refreshing network info cache for port 7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG nova.network.neutron [req-564c52ac-0c43-4e4c-8fe9-4f06b3001b75 req-23cf0776-fff0-4e75-bea5-0611b7181922 service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Updated VIF entry in instance network info cache for port 7c80870a-3c7c-4ead-b0ac-e257279721c0. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG nova.network.neutron [req-564c52ac-0c43-4e4c-8fe9-4f06b3001b75 req-23cf0776-fff0-4e75-bea5-0611b7181922 service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Updating instance_info_cache with network_info: [{"id": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "address": "fa:16:3e:88:d3:3b", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c80870a-3c", "ovs_interfaceid": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "eae356d7-073d-434c-abad-74c56205d364" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "eae356d7-073d-434c-abad-74c56205d364" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "eae356d7-073d-434c-abad-74c56205d364-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "eae356d7-073d-434c-abad-74c56205d364-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "eae356d7-073d-434c-abad-74c56205d364-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:37 user nova-compute[74646]: INFO nova.compute.manager [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Terminating instance
Oct 26 16:15:37 user nova-compute[74646]: DEBUG nova.compute.manager [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:15:37 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-564c52ac-0c43-4e4c-8fe9-4f06b3001b75 req-23cf0776-fff0-4e75-bea5-0611b7181922 service nova] Releasing lock "refresh_cache-eae356d7-073d-434c-abad-74c56205d364" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:15:38 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: eae356d7-073d-434c-abad-74c56205d364] Instance destroyed successfully.
Oct 26 16:15:38 user nova-compute[74646]: DEBUG nova.objects.instance [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lazy-loading 'resources' on Instance uuid eae356d7-073d-434c-abad-74c56205d364 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1739808527',display_name='tempest-AttachVolumeNegativeTest-server-1739808527',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1739808527',id=39,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJDGlRSpfJVHzxZBaQ2K1l6R9HWy9mxEE7WYIBF4Q7ncYOANKOTIl+a2r2BIWlXru6ARxDMtA0RnMQBwKyAf/dQ+SKEZDKQNKgEfBKdtIlQVxI/Jvll8TzFv8Je40dEYLw==',key_name='tempest-keypair-2100886243',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f24b251085ed49c991eef6c2df0b0990',ramdisk_id='',reservation_id='r-hjxo4zi8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-340789388',owner_user_name='tempest-AttachVolumeNegativeTest-340789388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:13:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41c8a2a8c5594cca9451ab93e681dcd0',uuid=eae356d7-073d-434c-abad-74c56205d364,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "address": "fa:16:3e:88:d3:3b", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c80870a-3c", "ovs_interfaceid": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converting VIF {"id": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "address": "fa:16:3e:88:d3:3b", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c80870a-3c", "ovs_interfaceid": "7c80870a-3c7c-4ead-b0ac-e257279721c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:d3:3b,bridge_name='br-int',has_traffic_filtering=True,id=7c80870a-3c7c-4ead-b0ac-e257279721c0,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c80870a-3c') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG os_vif [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d3:3b,bridge_name='br-int',has_traffic_filtering=True,id=7c80870a-3c7c-4ead-b0ac-e257279721c0,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c80870a-3c') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c80870a-3c, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e653b665-03e6-4679-840a-58a5e96ca227) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:38 user nova-compute[74646]: INFO os_vif [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:d3:3b,bridge_name='br-int',has_traffic_filtering=True,id=7c80870a-3c7c-4ead-b0ac-e257279721c0,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c80870a-3c')
Oct 26 16:15:38 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Deleting instance files /opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364_del
Oct 26 16:15:38 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Deletion of /opt/stack/data/nova/instances/eae356d7-073d-434c-abad-74c56205d364_del complete
Oct 26 16:15:38 user nova-compute[74646]: INFO nova.compute.manager [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: eae356d7-073d-434c-abad-74c56205d364] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 26 16:15:38 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: eae356d7-073d-434c-abad-74c56205d364] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: eae356d7-073d-434c-abad-74c56205d364] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:15:38 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Error from libvirt while getting description of instance-00000027: [Error Code 42] Domain not found: no domain with matching uuid 'eae356d7-073d-434c-abad-74c56205d364' (instance-00000027): libvirt.libvirtError: Domain not found: no domain with matching uuid 'eae356d7-073d-434c-abad-74c56205d364' (instance-00000027)
Oct 26 16:15:38 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:15:38 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-b35ae10f-3e0a-41c9-a465-9778e5f21a82 req-d90e76ed-ce2c-4701-8893-af917d81e641 service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Received event network-vif-unplugged-7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b35ae10f-3e0a-41c9-a465-9778e5f21a82 req-d90e76ed-ce2c-4701-8893-af917d81e641 service nova] Acquiring lock "eae356d7-073d-434c-abad-74c56205d364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b35ae10f-3e0a-41c9-a465-9778e5f21a82 req-d90e76ed-ce2c-4701-8893-af917d81e641 service nova] Lock "eae356d7-073d-434c-abad-74c56205d364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b35ae10f-3e0a-41c9-a465-9778e5f21a82 req-d90e76ed-ce2c-4701-8893-af917d81e641 service nova] Lock "eae356d7-073d-434c-abad-74c56205d364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-b35ae10f-3e0a-41c9-a465-9778e5f21a82 req-d90e76ed-ce2c-4701-8893-af917d81e641 service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] No waiting events found dispatching network-vif-unplugged-7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-b35ae10f-3e0a-41c9-a465-9778e5f21a82 req-d90e76ed-ce2c-4701-8893-af917d81e641 service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Received event network-vif-unplugged-7c80870a-3c7c-4ead-b0ac-e257279721c0 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-b35ae10f-3e0a-41c9-a465-9778e5f21a82 req-d90e76ed-ce2c-4701-8893-af917d81e641 service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Received event network-vif-plugged-7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b35ae10f-3e0a-41c9-a465-9778e5f21a82 req-d90e76ed-ce2c-4701-8893-af917d81e641 service nova] Acquiring lock "eae356d7-073d-434c-abad-74c56205d364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b35ae10f-3e0a-41c9-a465-9778e5f21a82 req-d90e76ed-ce2c-4701-8893-af917d81e641 service nova] Lock "eae356d7-073d-434c-abad-74c56205d364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b35ae10f-3e0a-41c9-a465-9778e5f21a82 req-d90e76ed-ce2c-4701-8893-af917d81e641 service nova] Lock "eae356d7-073d-434c-abad-74c56205d364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-b35ae10f-3e0a-41c9-a465-9778e5f21a82 req-d90e76ed-ce2c-4701-8893-af917d81e641 service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] No waiting events found dispatching network-vif-plugged-7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:15:39 user nova-compute[74646]: WARNING nova.compute.manager [req-b35ae10f-3e0a-41c9-a465-9778e5f21a82 req-d90e76ed-ce2c-4701-8893-af917d81e641 service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Received unexpected event network-vif-plugged-7c80870a-3c7c-4ead-b0ac-e257279721c0 for instance with vm_state active and task_state deleting.
Oct 26 16:15:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-04b31c41-a71b-422f-ab6d-dd7ac7d43238 req-ae5f406c-c802-41da-b8f5-b4343fa2f86e service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Received event network-vif-deleted-7c80870a-3c7c-4ead-b0ac-e257279721c0 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:15:39 user nova-compute[74646]: INFO nova.compute.manager [req-04b31c41-a71b-422f-ab6d-dd7ac7d43238 req-ae5f406c-c802-41da-b8f5-b4343fa2f86e service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Neutron deleted interface 7c80870a-3c7c-4ead-b0ac-e257279721c0; detaching it from the instance and deleting it from the info cache
Oct 26 16:15:39 user nova-compute[74646]: DEBUG nova.network.neutron [req-04b31c41-a71b-422f-ab6d-dd7ac7d43238 req-ae5f406c-c802-41da-b8f5-b4343fa2f86e service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: eae356d7-073d-434c-abad-74c56205d364] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG nova.compute.manager [req-04b31c41-a71b-422f-ab6d-dd7ac7d43238 req-ae5f406c-c802-41da-b8f5-b4343fa2f86e service nova] [instance: eae356d7-073d-434c-abad-74c56205d364] Detach interface failed, port_id=7c80870a-3c7c-4ead-b0ac-e257279721c0, reason: Instance eae356d7-073d-434c-abad-74c56205d364 could not be found. {{(pid=74646) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 16:15:39 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: eae356d7-073d-434c-abad-74c56205d364] Took 0.81 seconds to deallocate network for instance.
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:15:39 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.336s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:40 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Deleted allocations for instance eae356d7-073d-434c-abad-74c56205d364
Oct 26 16:15:40 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:15:40 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8147MB free_disk=25.05184555053711GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-0b6d6698-c489-467d-b3b1-596dad8f1b8d tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "eae356d7-073d-434c-abad-74c56205d364" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.621s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 511f84be-7779-4856-8611-9171c1b59d58 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance f70f8714-4267-481f-bf97-e0afe03668a9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2bc4a961-4a5f-4477-8603-823adb496736 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance dd13d851-9338-4811-b48f-06c719844358 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 508f43f1-6d5c-41ed-9e4f-06eec0bc992e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_power_states {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 1283575f-b614-42d5-b632-c1409f295207 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid fa8813a4-be8c-452a-8d2d-a5fd972c2498 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 511f84be-7779-4856-8611-9171c1b59d58 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid f70f8714-4267-481f-bf97-e0afe03668a9 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 2bc4a961-4a5f-4477-8603-823adb496736 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid dd13d851-9338-4811-b48f-06c719844358 {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Triggering sync for uuid 508f43f1-6d5c-41ed-9e4f-06eec0bc992e {{(pid=74646) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "1283575f-b614-42d5-b632-c1409f295207" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "1283575f-b614-42d5-b632-c1409f295207" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "511f84be-7779-4856-8611-9171c1b59d58" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "511f84be-7779-4856-8611-9171c1b59d58" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "f70f8714-4267-481f-bf97-e0afe03668a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "2bc4a961-4a5f-4477-8603-823adb496736" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "2bc4a961-4a5f-4477-8603-823adb496736" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "dd13d851-9338-4811-b48f-06c719844358" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "dd13d851-9338-4811-b48f-06c719844358" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "1283575f-b614-42d5-b632-c1409f295207" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "511f84be-7779-4856-8611-9171c1b59d58" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "2bc4a961-4a5f-4477-8603-823adb496736" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "f70f8714-4267-481f-bf97-e0afe03668a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "dd13d851-9338-4811-b48f-06c719844358" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.048s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:15:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:42 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:15:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:44 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:15:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:15:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "f70f8714-4267-481f-bf97-e0afe03668a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:07 user nova-compute[74646]: INFO nova.compute.manager [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Terminating instance
Oct 26 16:16:07 user nova-compute[74646]: DEBUG nova.compute.manager [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:16:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:07 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-3b0972c1-3646-49b5-b2ff-05a10a7c02e5 req-1d18fd5e-b646-41ce-b8a0-065ee06c8335 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-vif-unplugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3b0972c1-3646-49b5-b2ff-05a10a7c02e5 req-1d18fd5e-b646-41ce-b8a0-065ee06c8335 service nova] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3b0972c1-3646-49b5-b2ff-05a10a7c02e5 req-1d18fd5e-b646-41ce-b8a0-065ee06c8335 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3b0972c1-3646-49b5-b2ff-05a10a7c02e5 req-1d18fd5e-b646-41ce-b8a0-065ee06c8335 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-3b0972c1-3646-49b5-b2ff-05a10a7c02e5 req-1d18fd5e-b646-41ce-b8a0-065ee06c8335 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] No waiting events found dispatching network-vif-unplugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG nova.compute.manager [req-3b0972c1-3646-49b5-b2ff-05a10a7c02e5 req-1d18fd5e-b646-41ce-b8a0-065ee06c8335 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-vif-unplugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:08 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Instance destroyed successfully.
Oct 26 16:16:08 user nova-compute[74646]: DEBUG nova.objects.instance [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'resources' on Instance uuid f70f8714-4267-481f-bf97-e0afe03668a9 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:10:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1368171435',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1368171435',id=35,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:12:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90e848952345455183c15fee816b6f12',ramdisk_id='',reservation_id='r-fhizlcr9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-580785668',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:14:22Z,user_data=None,user_id='abd7a869c235467ca4da99867c6bc0d4',uuid=f70f8714-4267-481f-bf97-e0afe03668a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converting VIF {"id": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "address": "fa:16:3e:d9:39:0c", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4171750-84", "ovs_interfaceid": "d4171750-840e-4ebb-b99a-262d03c7e7a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:39:0c,bridge_name='br-int',has_traffic_filtering=True,id=d4171750-840e-4ebb-b99a-262d03c7e7a2,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4171750-84') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_vif [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:39:0c,bridge_name='br-int',has_traffic_filtering=True,id=d4171750-840e-4ebb-b99a-262d03c7e7a2,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4171750-84') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4171750-84, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e177e22-a65d-4cac-ad34-20b589f45fcb) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:08 user nova-compute[74646]: INFO os_vif [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:39:0c,bridge_name='br-int',has_traffic_filtering=True,id=d4171750-840e-4ebb-b99a-262d03c7e7a2,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4171750-84')
Oct 26 16:16:08 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'upQzlafP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:16:08 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20ebbd2-29f3-422e-ae72-19c889ff2f90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:16:08 user nova-compute[74646]: No targets found.
Oct 26 16:16:08 user nova-compute[74646]: iSNS:
Oct 26 16:16:08 user nova-compute[74646]: No targets found.
Oct 26 16:16:08 user nova-compute[74646]: STATIC:
Oct 26 16:16:08 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca
Oct 26 16:16:08 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:16:08 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:16:08 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89
Oct 26 16:16:08 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:16:08 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:16:08 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:16:08 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:16:08 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:16:08 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe
Oct 26 16:16:08 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:16:08 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:16:08 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e
Oct 26 16:16:08 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:16:08 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:16:08 user nova-compute[74646]: FIRMWARE:
Oct 26 16:16:08 user nova-compute[74646]: No targets found.
Oct 26 16:16:08 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:16:08 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:16:08 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[181bb69d-688f-4390-b2ff-c5dabb054aee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[363997ac-cdd1-44a2-9a34-7dc49157e542]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:16:08 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:16:08 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:16:08 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:16:08 user nova-compute[74646]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:16:08 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:16:08 user nova-compute[74646]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e (non-flash)
Oct 26 16:16:08 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:16:08 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:16:08 user nova-compute[74646]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:16:08 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e82e55a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e'): ({'sdb'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Removing single pathed devices sdb {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG nova.compute.manager [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e84733-2835-4b59-a180-ecd3784503f3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff342ca9-e5d7-4b11-971a-e35b7721a487]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Flushing IO for device /dev/sdb {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c516d9e-01a7-4900-bd0a-d487e7cd7c25]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:16:08 user nova-compute[74646]: INFO nova.compute.claims [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Claim successful on node user
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1df1e0-0ed2-449f-bdc4-eed4bb5e34be]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23834323739626535', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_f7d044a0', '/dev/disk/by-id/scsi-1SCST_BIOf7d044a0-84279be5150d1834') {{(pid=85624) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc81070-5c46-45c3-990b-809c0426817b]: (4, None) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da18cc7-78c5-41f9-95a9-54ee437ebb78]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4813f31-de83-40e2-848f-ce2b57089f40]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e, portal: 172.16.0.220,3260]
Oct 26 16:16:08 user nova-compute[74646]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e, portal: 172.16.0.220,3260] successful.
Oct 26 16:16:08 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f8507f31-36cd-4435-9fbf-4e2659db518e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d8a6c1-b75f-4d5b-b9c3-70131582b21a]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] <== disconnect_volume: return (351ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:16:08 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Deleting instance files /opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9_del
Oct 26 16:16:08 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Deletion of /opt/stack/data/nova/instances/f70f8714-4267-481f-bf97-e0afe03668a9_del complete
Oct 26 16:16:08 user nova-compute[74646]: INFO nova.compute.manager [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Took 1.23 seconds to destroy the instance on the hypervisor.
Oct 26 16:16:08 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:16:08 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.453s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG nova.network.neutron [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:16:09 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:16:09 user nova-compute[74646]: DEBUG nova.compute.manager [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG nova.policy [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '726dd5eaa0cd45ada546ac68fe04ef40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bffc92069c704c6fac59cda13fa72e52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:16:09 user nova-compute[74646]: INFO nova.virt.block_device [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Booting with volume 9a126a47-5333-4520-aac0-f6982c44715c at /dev/vda
Oct 26 16:16:09 user nova-compute[74646]: DEBUG os_brick.utils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[71af8f38-2978-42c4-b407-609bae5beeb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a823d4-0bf7-46ce-886e-a6b22134f9ac]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a7c875-5a2e-4610-b0f5-78299485a01a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac85fd34-01cf-4ac8-85e6-0bddfcf81d3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:16:09 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:16:09 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f7091e-5b49-4bee-97aa-515fe0623992]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG os_brick.utils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Updating existing volume attachment record: c8ceeebe-9944-43db-b279-94b3ba910fbe {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:16:09 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Took 0.71 seconds to deallocate network for instance.
Oct 26 16:16:09 user nova-compute[74646]: DEBUG nova.compute.manager [req-88a59a87-dd02-4595-a333-82dccdf3f906 req-1dbe5e84-94cc-49bb-83e4-c0e609121b85 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-vif-deleted-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:16:09 user nova-compute[74646]: DEBUG nova.network.neutron [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Successfully created port: 26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-97ae8909-cfb7-4031-8669-560cb31690e3 req-b0b71bab-3329-401f-8356-648ce89ccd44 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-97ae8909-cfb7-4031-8669-560cb31690e3 req-b0b71bab-3329-401f-8356-648ce89ccd44 service nova] Acquiring lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-97ae8909-cfb7-4031-8669-560cb31690e3 req-b0b71bab-3329-401f-8356-648ce89ccd44 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-97ae8909-cfb7-4031-8669-560cb31690e3 req-b0b71bab-3329-401f-8356-648ce89ccd44 service nova] Lock "f70f8714-4267-481f-bf97-e0afe03668a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG nova.compute.manager [req-97ae8909-cfb7-4031-8669-560cb31690e3 req-b0b71bab-3329-401f-8356-648ce89ccd44 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] No waiting events found dispatching network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:16:10 user nova-compute[74646]: WARNING nova.compute.manager [req-97ae8909-cfb7-4031-8669-560cb31690e3 req-b0b71bab-3329-401f-8356-648ce89ccd44 service nova] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Received unexpected event network-vif-plugged-d4171750-840e-4ebb-b99a-262d03c7e7a2 for instance with vm_state active and task_state deleting.
Oct 26 16:16:10 user nova-compute[74646]: DEBUG nova.network.neutron [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Successfully updated port: 26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "refresh_cache-ed415bf2-5b3a-4b37-b069-7d206f0d6700" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquired lock "refresh_cache-ed415bf2-5b3a-4b37-b069-7d206f0d6700" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG nova.network.neutron [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:16:10 user nova-compute[74646]: INFO nova.compute.manager [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: f70f8714-4267-481f-bf97-e0afe03668a9] Took 0.96 seconds to detach 1 volumes for instance.
Oct 26 16:16:10 user nova-compute[74646]: DEBUG nova.network.neutron [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG nova.network.neutron [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Updating instance_info_cache with network_info: [{"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Releasing lock "refresh_cache-ed415bf2-5b3a-4b37-b069-7d206f0d6700" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG nova.compute.manager [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Instance network_info: |[{"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:16:10 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:10 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Deleted allocations for instance f70f8714-4267-481f-bf97-e0afe03668a9
Oct 26 16:16:11 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b0e02bab-d99d-460a-916b-baea3d0c5a24 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "f70f8714-4267-481f-bf97-e0afe03668a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.428s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-b162197e-4a06-4214-a824-b5f31e1b903a req-735ec0e9-2877-49e6-aef1-31ae513a93ee service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-changed-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:16:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-b162197e-4a06-4214-a824-b5f31e1b903a req-735ec0e9-2877-49e6-aef1-31ae513a93ee service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Refreshing instance network info cache due to event network-changed-26d80c0f-407c-453c-94b9-8a19b9a0b11e. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:16:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b162197e-4a06-4214-a824-b5f31e1b903a req-735ec0e9-2877-49e6-aef1-31ae513a93ee service nova] Acquiring lock "refresh_cache-ed415bf2-5b3a-4b37-b069-7d206f0d6700" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:16:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b162197e-4a06-4214-a824-b5f31e1b903a req-735ec0e9-2877-49e6-aef1-31ae513a93ee service nova] Acquired lock "refresh_cache-ed415bf2-5b3a-4b37-b069-7d206f0d6700" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:16:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-b162197e-4a06-4214-a824-b5f31e1b903a req-735ec0e9-2877-49e6-aef1-31ae513a93ee service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Refreshing network info cache for port 26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:16:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-b162197e-4a06-4214-a824-b5f31e1b903a req-735ec0e9-2877-49e6-aef1-31ae513a93ee service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Updated VIF entry in instance network info cache for port 26d80c0f-407c-453c-94b9-8a19b9a0b11e. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:16:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-b162197e-4a06-4214-a824-b5f31e1b903a req-735ec0e9-2877-49e6-aef1-31ae513a93ee service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Updating instance_info_cache with network_info: [{"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:16:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b162197e-4a06-4214-a824-b5f31e1b903a req-735ec0e9-2877-49e6-aef1-31ae513a93ee service nova] Releasing lock "refresh_cache-ed415bf2-5b3a-4b37-b069-7d206f0d6700" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:16:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.compute.manager [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:16:28 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Creating image(s)
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Ensure instance console log exists: /opt/stack/data/nova/instances/ed415bf2-5b3a-4b37-b069-7d206f0d6700/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Start _get_guest_xml network_info=[{"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'c8ceeebe-9944-43db-b279-94b3ba910fbe', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSmuCPNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed415bf2-5b3a-4b37-b069-7d206f0d6700', 'attached_at': '', 'detached_at': '', 'volume_id': '9a126a47-5333-4520-aac0-f6982c44715c', 'serial': '9a126a47-5333-4520-aac0-f6982c44715c'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:16:28 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:16:28 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSmuCPNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:16:28 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:16:28 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:16:28 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf87b851-f8b6-4de8-9470-b13dd09731f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:16:28 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f94fc6-380e-47de-8c6f-b533e1f43d29]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c] added
Oct 26 16:16:28 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[002e7378-1088-4f7e-a00d-2840b68097dd]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[38163e90-a33d-4745-832d-dd9edd4342dd]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iSmuCPNh {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iSmuCPNh" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5522d6-d03d-41d1-ad2e-6f27170d1b55]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iSmuCPNh'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a10ce41-89fa-4062-a105-6a7c4ee792ef]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd1fe86-918b-4e8c-baed-537fa25ed34a]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:16:28 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:16:28 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:16:28 user nova-compute[74646]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:16:28 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:16:28 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:16:28 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:16:28 user nova-compute[74646]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:16:28 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f6de2a-9860-4fa1-851e-e84a2acf200d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260]
Oct 26 16:16:28 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260] successful.
Oct 26 16:16:28 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5a4891-cbf8-43ce-b132-7857c9acaf50]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[54714334-9a44-4eb7-af36-a18728717723]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:16:28 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:16:28 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:16:28 user nova-compute[74646]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:16:28 user nova-compute[74646]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:16:28 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:16:28 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:16:28 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:16:28 user nova-compute[74646]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:16:28 user nova-compute[74646]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:16:28 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d36181-11a4-4640-9d19-8d52517f0f18]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: None {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:16:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "2bc4a961-4a5f-4477-8603-823adb496736" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "2bc4a961-4a5f-4477-8603-823adb496736" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:29 user nova-compute[74646]: INFO nova.compute.manager [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Detaching volume b5d47359-f8a6-4aaf-a397-96255274e2ca
Oct 26 16:16:29 user nova-compute[74646]: INFO nova.virt.block_device [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Attempting to driver detach volume b5d47359-f8a6-4aaf-a397-96255274e2ca from mountpoint /dev/vdb
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Attempting to detach device vdb from instance 2bc4a961-4a5f-4477-8603-823adb496736 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:16:29 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:16:29 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:16:29 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:16:29 user nova-compute[74646]:   <serial>b5d47359-f8a6-4aaf-a397-96255274e2ca</serial>
Oct 26 16:16:29 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:16:29 user nova-compute[74646]: </disk>
Oct 26 16:16:29 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:16:29 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Successfully detached device vdb from instance 2bc4a961-4a5f-4477-8603-823adb496736 from the persistent domain config.
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2bc4a961-4a5f-4477-8603-823adb496736 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:16:29 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:16:29 user nova-compute[74646]:   <source dev="/dev/sdd"/>
Oct 26 16:16:29 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:16:29 user nova-compute[74646]:   <serial>b5d47359-f8a6-4aaf-a397-96255274e2ca</serial>
Oct 26 16:16:29 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:16:29 user nova-compute[74646]: </disk>
Oct 26 16:16:29 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSmuCPNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '26632353965383734', 'path': '/dev/sdb'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632353965383734', 'path': '/dev/sdb'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-508729915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-508729915',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0IqpbEUj9FTXwsltPcQQxE3mw3HOun3lOf6u+YSQ0CcyJV6/G/ONdi3SGnlhdvJqfyz0BhUnqVGVb/CKZrfcM/4Xw4szISMudN+QKZ31ox5/FMuTnBsO4uIsAc0O90zg==',key_name='tempest-keypair-341580469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffc92069c704c6fac59cda13fa72e52',ramdisk_id='',reservation_id='r-7wch87hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1491440656',owner_user_name='tempest-ServerActionsV293TestJSON-1491440656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:16:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='726dd5eaa0cd45ada546ac68fe04ef40',uuid=ed415bf2-5b3a-4b37-b069-7d206f0d6700,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Converting VIF {"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:3c:86,bridge_name='br-int',has_traffic_filtering=True,id=26d80c0f-407c-453c-94b9-8a19b9a0b11e,network=Network(e5675dc6-92c8-465e-a116-18c24d116464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26d80c0f-40') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.objects.instance [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lazy-loading 'pci_devices' on Instance uuid ed415bf2-5b3a-4b37-b069-7d206f0d6700 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:16:29 user nova-compute[74646]:   <uuid>ed415bf2-5b3a-4b37-b069-7d206f0d6700</uuid>
Oct 26 16:16:29 user nova-compute[74646]:   <name>instance-00000029</name>
Oct 26 16:16:29 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:16:29 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:16:29 user nova-compute[74646]:   <metadata>
Oct 26 16:16:29 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:16:29 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:16:29 user nova-compute[74646]:       <nova:name>tempest-ServerActionsV293TestJSON-server-508729915</nova:name>
Oct 26 16:16:29 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:16:28</nova:creationTime>
Oct 26 16:16:29 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:16:29 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:16:29 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:16:29 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:16:29 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:16:29 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:16:29 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:16:29 user nova-compute[74646]:       <nova:owner>
Oct 26 16:16:29 user nova-compute[74646]:         <nova:user uuid="726dd5eaa0cd45ada546ac68fe04ef40">tempest-ServerActionsV293TestJSON-1491440656-project-member</nova:user>
Oct 26 16:16:29 user nova-compute[74646]:         <nova:project uuid="bffc92069c704c6fac59cda13fa72e52">tempest-ServerActionsV293TestJSON-1491440656</nova:project>
Oct 26 16:16:29 user nova-compute[74646]:       </nova:owner>
Oct 26 16:16:29 user nova-compute[74646]:       <nova:ports>
Oct 26 16:16:29 user nova-compute[74646]:         <nova:port uuid="26d80c0f-407c-453c-94b9-8a19b9a0b11e">
Oct 26 16:16:29 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 16:16:29 user nova-compute[74646]:         </nova:port>
Oct 26 16:16:29 user nova-compute[74646]:       </nova:ports>
Oct 26 16:16:29 user nova-compute[74646]:     </nova:instance>
Oct 26 16:16:29 user nova-compute[74646]:   </metadata>
Oct 26 16:16:29 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:16:29 user nova-compute[74646]:     <system>
Oct 26 16:16:29 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:16:29 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:16:29 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:16:29 user nova-compute[74646]:       <entry name="serial">ed415bf2-5b3a-4b37-b069-7d206f0d6700</entry>
Oct 26 16:16:29 user nova-compute[74646]:       <entry name="uuid">ed415bf2-5b3a-4b37-b069-7d206f0d6700</entry>
Oct 26 16:16:29 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:16:29 user nova-compute[74646]:     </system>
Oct 26 16:16:29 user nova-compute[74646]:   </sysinfo>
Oct 26 16:16:29 user nova-compute[74646]:   <os>
Oct 26 16:16:29 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:16:29 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:16:29 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:16:29 user nova-compute[74646]:   </os>
Oct 26 16:16:29 user nova-compute[74646]:   <features>
Oct 26 16:16:29 user nova-compute[74646]:     <acpi/>
Oct 26 16:16:29 user nova-compute[74646]:     <apic/>
Oct 26 16:16:29 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:16:29 user nova-compute[74646]:   </features>
Oct 26 16:16:29 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:16:29 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:16:29 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:16:29 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:16:29 user nova-compute[74646]:   </clock>
Oct 26 16:16:29 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:16:29 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:16:29 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:16:29 user nova-compute[74646]:   </cpu>
Oct 26 16:16:29 user nova-compute[74646]:   <devices>
Oct 26 16:16:29 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:16:29 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:16:29 user nova-compute[74646]:       <source dev="/dev/sdb"/>
Oct 26 16:16:29 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:16:29 user nova-compute[74646]:       <serial>9a126a47-5333-4520-aac0-f6982c44715c</serial>
Oct 26 16:16:29 user nova-compute[74646]:     </disk>
Oct 26 16:16:29 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:16:29 user nova-compute[74646]:       <mac address="fa:16:3e:ae:3c:86"/>
Oct 26 16:16:29 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:16:29 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:16:29 user nova-compute[74646]:       <target dev="tap26d80c0f-40"/>
Oct 26 16:16:29 user nova-compute[74646]:     </interface>
Oct 26 16:16:29 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:16:29 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/ed415bf2-5b3a-4b37-b069-7d206f0d6700/console.log" append="off"/>
Oct 26 16:16:29 user nova-compute[74646]:     </serial>
Oct 26 16:16:29 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:16:29 user nova-compute[74646]:     <video>
Oct 26 16:16:29 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:16:29 user nova-compute[74646]:     </video>
Oct 26 16:16:29 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:16:29 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:16:29 user nova-compute[74646]:     </rng>
Oct 26 16:16:29 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:16:29 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:16:29 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:16:29 user nova-compute[74646]:     </memballoon>
Oct 26 16:16:29 user nova-compute[74646]:   </devices>
Oct 26 16:16:29 user nova-compute[74646]: </domain>
Oct 26 16:16:29 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-508729915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-508729915',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0IqpbEUj9FTXwsltPcQQxE3mw3HOun3lOf6u+YSQ0CcyJV6/G/ONdi3SGnlhdvJqfyz0BhUnqVGVb/CKZrfcM/4Xw4szISMudN+QKZ31ox5/FMuTnBsO4uIsAc0O90zg==',key_name='tempest-keypair-341580469',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bffc92069c704c6fac59cda13fa72e52',ramdisk_id='',reservation_id='r-7wch87hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1491440656',owner_user_name='tempest-ServerActionsV293TestJSON-1491440656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:16:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='726dd5eaa0cd45ada546ac68fe04ef40',uuid=ed415bf2-5b3a-4b37-b069-7d206f0d6700,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Converting VIF {"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:3c:86,bridge_name='br-int',has_traffic_filtering=True,id=26d80c0f-407c-453c-94b9-8a19b9a0b11e,network=Network(e5675dc6-92c8-465e-a116-18c24d116464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26d80c0f-40') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG os_vif [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:3c:86,bridge_name='br-int',has_traffic_filtering=True,id=26d80c0f-407c-453c-94b9-8a19b9a0b11e,network=Network(e5675dc6-92c8-465e-a116-18c24d116464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26d80c0f-40') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9f3c9ce-b42d-5eb0-ab3b-8d75922ccaa2', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26d80c0f-40, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26d80c0f-40, col_values=(('qos', UUID('816ef7ba-433d-4a2b-aef3-750ec9b87c98')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26d80c0f-40, col_values=(('external_ids', {'iface-id': '26d80c0f-407c-453c-94b9-8a19b9a0b11e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:3c:86', 'vm-uuid': 'ed415bf2-5b3a-4b37-b069-7d206f0d6700'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:29 user nova-compute[74646]: INFO os_vif [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:3c:86,bridge_name='br-int',has_traffic_filtering=True,id=26d80c0f-407c-453c-94b9-8a19b9a0b11e,network=Network(e5675dc6-92c8-465e-a116-18c24d116464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26d80c0f-40')
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] No VIF found with MAC fa:16:3e:ae:3c:86, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:16:29 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2bc4a961-4a5f-4477-8603-823adb496736 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:16:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:31 user nova-compute[74646]: DEBUG nova.compute.manager [req-96ac2d91-9544-421e-a9ee-9b57b6c75e07 req-83719ffa-6329-4bb0-851d-2be0a77eda8f service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:16:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-96ac2d91-9544-421e-a9ee-9b57b6c75e07 req-83719ffa-6329-4bb0-851d-2be0a77eda8f service nova] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-96ac2d91-9544-421e-a9ee-9b57b6c75e07 req-83719ffa-6329-4bb0-851d-2be0a77eda8f service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:31 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-96ac2d91-9544-421e-a9ee-9b57b6c75e07 req-83719ffa-6329-4bb0-851d-2be0a77eda8f service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:31 user nova-compute[74646]: DEBUG nova.compute.manager [req-96ac2d91-9544-421e-a9ee-9b57b6c75e07 req-83719ffa-6329-4bb0-851d-2be0a77eda8f service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] No waiting events found dispatching network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:16:31 user nova-compute[74646]: WARNING nova.compute.manager [req-96ac2d91-9544-421e-a9ee-9b57b6c75e07 req-83719ffa-6329-4bb0-851d-2be0a77eda8f service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received unexpected event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e for instance with vm_state building and task_state spawning.
Oct 26 16:16:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:33 user nova-compute[74646]: DEBUG nova.compute.manager [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:16:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:16:33 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Instance spawned successfully.
Oct 26 16:16:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:16:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:16:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:16:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:16:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:16:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:16:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:16:33 user nova-compute[74646]: INFO nova.compute.manager [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Took 5.15 seconds to spawn the instance on the hypervisor.
Oct 26 16:16:33 user nova-compute[74646]: DEBUG nova.compute.manager [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:16:33 user nova-compute[74646]: INFO nova.compute.manager [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Took 24.61 seconds to build instance.
Oct 26 16:16:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-819e9248-a688-42e3-9b27-cf645a960ed7 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.717s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-07b9d0cc-5927-4111-bf5f-7e5176ebb541 req-99670314-43e8-4cc7-9b26-5cc60d3af84b service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:16:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-07b9d0cc-5927-4111-bf5f-7e5176ebb541 req-99670314-43e8-4cc7-9b26-5cc60d3af84b service nova] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-07b9d0cc-5927-4111-bf5f-7e5176ebb541 req-99670314-43e8-4cc7-9b26-5cc60d3af84b service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-07b9d0cc-5927-4111-bf5f-7e5176ebb541 req-99670314-43e8-4cc7-9b26-5cc60d3af84b service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:33 user nova-compute[74646]: DEBUG nova.compute.manager [req-07b9d0cc-5927-4111-bf5f-7e5176ebb541 req-99670314-43e8-4cc7-9b26-5cc60d3af84b service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] No waiting events found dispatching network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:16:33 user nova-compute[74646]: WARNING nova.compute.manager [req-07b9d0cc-5927-4111-bf5f-7e5176ebb541 req-99670314-43e8-4cc7-9b26-5cc60d3af84b service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received unexpected event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e for instance with vm_state active and task_state None.
Oct 26 16:16:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:16:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:36 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:16:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:37 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:16:37 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:16:37 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:16:37 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:16:38 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:16:38 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:16:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:16:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:16:38 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:16:38 user nova-compute[74646]: DEBUG nova.compute.manager [req-2ccd5633-fcf5-4651-9484-b70d77966865 req-ca461b54-60fc-4f78-98db-92e7378a0c96 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Received event network-changed-a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:16:38 user nova-compute[74646]: DEBUG nova.compute.manager [req-2ccd5633-fcf5-4651-9484-b70d77966865 req-ca461b54-60fc-4f78-98db-92e7378a0c96 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Refreshing instance network info cache due to event network-changed-a3d137ce-6a6c-4f92-98fd-c4752d199e3c. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:16:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2ccd5633-fcf5-4651-9484-b70d77966865 req-ca461b54-60fc-4f78-98db-92e7378a0c96 service nova] Acquiring lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:16:38 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2ccd5633-fcf5-4651-9484-b70d77966865 req-ca461b54-60fc-4f78-98db-92e7378a0c96 service nova] Acquired lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:16:38 user nova-compute[74646]: DEBUG nova.network.neutron [req-2ccd5633-fcf5-4651-9484-b70d77966865 req-ca461b54-60fc-4f78-98db-92e7378a0c96 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Refreshing network info cache for port a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:16:38 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Updating instance_info_cache with network_info: [{"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-fa8813a4-be8c-452a-8d2d-a5fd972c2498" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG nova.network.neutron [req-2ccd5633-fcf5-4651-9484-b70d77966865 req-ca461b54-60fc-4f78-98db-92e7378a0c96 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Updated VIF entry in instance network info cache for port a3d137ce-6a6c-4f92-98fd-c4752d199e3c. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG nova.network.neutron [req-2ccd5633-fcf5-4651-9484-b70d77966865 req-ca461b54-60fc-4f78-98db-92e7378a0c96 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Updating instance_info_cache with network_info: [{"id": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "address": "fa:16:3e:1b:eb:e2", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d137ce-6a", "ovs_interfaceid": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-2ccd5633-fcf5-4651-9484-b70d77966865 req-ca461b54-60fc-4f78-98db-92e7378a0c96 service nova] Releasing lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:16:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:40 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:16:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:41 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:16:41 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:16:41 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8295MB free_disk=25.07656478881836GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 511f84be-7779-4856-8611-9171c1b59d58 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 2bc4a961-4a5f-4477-8603-823adb496736 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance dd13d851-9338-4811-b48f-06c719844358 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 508f43f1-6d5c-41ed-9e4f-06eec0bc992e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance ed415bf2-5b3a-4b37-b069-7d206f0d6700 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.412s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-c4e20892-eb61-412d-832f-8f1105add5de req-8057f8f7-0bb4-4104-8125-505fdb06a458 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-changed-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-c4e20892-eb61-412d-832f-8f1105add5de req-8057f8f7-0bb4-4104-8125-505fdb06a458 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Refreshing instance network info cache due to event network-changed-c86c4c00-d0ce-47d4-94d0-bf17114750a4. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c4e20892-eb61-412d-832f-8f1105add5de req-8057f8f7-0bb4-4104-8125-505fdb06a458 service nova] Acquiring lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c4e20892-eb61-412d-832f-8f1105add5de req-8057f8f7-0bb4-4104-8125-505fdb06a458 service nova] Acquired lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG nova.network.neutron [req-c4e20892-eb61-412d-832f-8f1105add5de req-8057f8f7-0bb4-4104-8125-505fdb06a458 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Refreshing network info cache for port c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:45 user nova-compute[74646]: INFO nova.compute.manager [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Terminating instance
Oct 26 16:16:45 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:45 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Instance destroyed successfully.
Oct 26 16:16:45 user nova-compute[74646]: DEBUG nova.objects.instance [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lazy-loading 'resources' on Instance uuid 508f43f1-6d5c-41ed-9e4f-06eec0bc992e {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T16:11:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1418828722',display_name='tempest-TestShelveInstance-server-1418828722',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1418828722',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPK2eHzEUaiGM5e5vpC9TarAxO4Mz7lrRG1J0qSm/+2qJRDNi3DljnpTw20ljayeJeyEhD9W2UNlOqdrFNjtV+EnKppj50o3I4hdhJ4vIwUnPqg91zAuepcDmr91vbFC8Q==',key_name='tempest-TestShelveInstance-1854031540',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:15:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d6af06081e14055b3b812f706d5ef20',ramdisk_id='',reservation_id='r-g1u9k9d5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-48608582',owner_user_name='tempest-TestShelveInstance-48608582-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:15:19Z,user_data=None,user_id='35ad85c745c94ba983e147c8dd2dcbc2',uuid=508f43f1-6d5c-41ed-9e4f-06eec0bc992e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Converting VIF {"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:2f:b6,bridge_name='br-int',has_traffic_filtering=True,id=c86c4c00-d0ce-47d4-94d0-bf17114750a4,network=Network(841be5f4-a63c-4f93-aa53-42702b4ccd16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86c4c00-d0') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG os_vif [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:2f:b6,bridge_name='br-int',has_traffic_filtering=True,id=c86c4c00-d0ce-47d4-94d0-bf17114750a4,network=Network(841be5f4-a63c-4f93-aa53-42702b4ccd16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86c4c00-d0') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc86c4c00-d0, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f6545df2-3faa-4cfb-9709-503bbec6f335) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:45 user nova-compute[74646]: INFO os_vif [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:2f:b6,bridge_name='br-int',has_traffic_filtering=True,id=c86c4c00-d0ce-47d4-94d0-bf17114750a4,network=Network(841be5f4-a63c-4f93-aa53-42702b4ccd16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc86c4c00-d0')
Oct 26 16:16:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iNBOtrTU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:16:45 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:16:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[707ee752-9d70-46e8-bb3f-520d86e5d729]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:16:46 user nova-compute[74646]: No targets found.
Oct 26 16:16:46 user nova-compute[74646]: iSNS:
Oct 26 16:16:46 user nova-compute[74646]: No targets found.
Oct 26 16:16:46 user nova-compute[74646]: STATIC:
Oct 26 16:16:46 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca
Oct 26 16:16:46 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:16:46 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:16:46 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89
Oct 26 16:16:46 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:16:46 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:16:46 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:16:46 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:16:46 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:16:46 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe
Oct 26 16:16:46 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:16:46 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:16:46 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c
Oct 26 16:16:46 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:16:46 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:16:46 user nova-compute[74646]: FIRMWARE:
Oct 26 16:16:46 user nova-compute[74646]: No targets found.
Oct 26 16:16:46 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:16:46 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:16:46 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5030e23-5047-4e0a-be18-361a78825852]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[011b175a-aee0-4a26-a1a7-d45b1f8a7254]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:16:46 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:16:46 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:16:46 user nova-compute[74646]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:16:46 user nova-compute[74646]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:16:46 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:16:46 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:16:46 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:16:46 user nova-compute[74646]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe (non-flash)
Oct 26 16:16:46 user nova-compute[74646]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:16:46 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e83d9b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe'): ({'sdf'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Removing single pathed devices sdf {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bfd500-8488-47cd-a14f-99d53d895936]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d182eb3-cfe7-4cd9-a07b-e366174ae387]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Flushing IO for device /dev/sdf {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36d105e-d7ad-48a5-b147-dfa84be1a3e2]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.051s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0df5e04-e656-48bb-a612-7b691740673e]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] SCSI volumes sdf have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23464623731363734', '/dev/disk/by-id/scsi-1SCST_BIOd2aa9b4c-4db71674e3e620d2', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d2aa9b4c') {{(pid=85624) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc3e2ce-978e-422b-a828-2d037bf31e72]: (4, None) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ce6c43-6696-4dc6-8917-36042fc0557e]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa7ab05-2f88-4da8-be48-5fd7d8c7a7f7]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260]
Oct 26 16:16:46 user nova-compute[74646]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe, portal: 172.16.0.220,3260] successful.
Oct 26 16:16:46 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG nova.network.neutron [req-c4e20892-eb61-412d-832f-8f1105add5de req-8057f8f7-0bb4-4104-8125-505fdb06a458 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updated VIF entry in instance network info cache for port c86c4c00-d0ce-47d4-94d0-bf17114750a4. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG nova.network.neutron [req-c4e20892-eb61-412d-832f-8f1105add5de req-8057f8f7-0bb4-4104-8125-505fdb06a458 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updating instance_info_cache with network_info: [{"id": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "address": "fa:16:3e:13:2f:b6", "network": {"id": "841be5f4-a63c-4f93-aa53-42702b4ccd16", "bridge": "br-int", "label": "tempest-TestShelveInstance-253237575-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d6af06081e14055b3b812f706d5ef20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc86c4c00-d0", "ovs_interfaceid": "c86c4c00-d0ce-47d4-94d0-bf17114750a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55cab237-57fe-4ecb-aba7-a1827f4ecdbe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[98ac80bd-3a90-4c66-871e-ca6cc423ed2b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] <== disconnect_volume: return (334ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:16:46 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Deleting instance files /opt/stack/data/nova/instances/508f43f1-6d5c-41ed-9e4f-06eec0bc992e_del
Oct 26 16:16:46 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Deletion of /opt/stack/data/nova/instances/508f43f1-6d5c-41ed-9e4f-06eec0bc992e_del complete
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-c4e20892-eb61-412d-832f-8f1105add5de req-8057f8f7-0bb4-4104-8125-505fdb06a458 service nova] Releasing lock "refresh_cache-508f43f1-6d5c-41ed-9e4f-06eec0bc992e" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:16:46 user nova-compute[74646]: INFO nova.compute.manager [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:16:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:47 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:16:47 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Took 0.80 seconds to deallocate network for instance.
Oct 26 16:16:47 user nova-compute[74646]: DEBUG nova.compute.manager [req-966ea001-af02-49e9-a3a3-295bc20a8184 req-6b14a46c-6cdd-4ba8-84f9-128bcab69b20 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-vif-unplugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:16:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-966ea001-af02-49e9-a3a3-295bc20a8184 req-6b14a46c-6cdd-4ba8-84f9-128bcab69b20 service nova] Acquiring lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-966ea001-af02-49e9-a3a3-295bc20a8184 req-6b14a46c-6cdd-4ba8-84f9-128bcab69b20 service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-966ea001-af02-49e9-a3a3-295bc20a8184 req-6b14a46c-6cdd-4ba8-84f9-128bcab69b20 service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:47 user nova-compute[74646]: DEBUG nova.compute.manager [req-966ea001-af02-49e9-a3a3-295bc20a8184 req-6b14a46c-6cdd-4ba8-84f9-128bcab69b20 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] No waiting events found dispatching network-vif-unplugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:16:47 user nova-compute[74646]: DEBUG nova.compute.manager [req-966ea001-af02-49e9-a3a3-295bc20a8184 req-6b14a46c-6cdd-4ba8-84f9-128bcab69b20 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-vif-unplugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:16:47 user nova-compute[74646]: DEBUG nova.compute.manager [req-966ea001-af02-49e9-a3a3-295bc20a8184 req-6b14a46c-6cdd-4ba8-84f9-128bcab69b20 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:16:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-966ea001-af02-49e9-a3a3-295bc20a8184 req-6b14a46c-6cdd-4ba8-84f9-128bcab69b20 service nova] Acquiring lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-966ea001-af02-49e9-a3a3-295bc20a8184 req-6b14a46c-6cdd-4ba8-84f9-128bcab69b20 service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-966ea001-af02-49e9-a3a3-295bc20a8184 req-6b14a46c-6cdd-4ba8-84f9-128bcab69b20 service nova] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:47 user nova-compute[74646]: DEBUG nova.compute.manager [req-966ea001-af02-49e9-a3a3-295bc20a8184 req-6b14a46c-6cdd-4ba8-84f9-128bcab69b20 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] No waiting events found dispatching network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:16:47 user nova-compute[74646]: WARNING nova.compute.manager [req-966ea001-af02-49e9-a3a3-295bc20a8184 req-6b14a46c-6cdd-4ba8-84f9-128bcab69b20 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received unexpected event network-vif-plugged-c86c4c00-d0ce-47d4-94d0-bf17114750a4 for instance with vm_state active and task_state deleting.
Oct 26 16:16:47 user nova-compute[74646]: DEBUG nova.compute.manager [req-966ea001-af02-49e9-a3a3-295bc20a8184 req-6b14a46c-6cdd-4ba8-84f9-128bcab69b20 service nova] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Received event network-vif-deleted-c86c4c00-d0ce-47d4-94d0-bf17114750a4 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:16:48 user nova-compute[74646]: INFO nova.compute.manager [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Took 0.94 seconds to detach 1 volumes for instance.
Oct 26 16:16:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] [instance: 508f43f1-6d5c-41ed-9e4f-06eec0bc992e] Deleting volume: 55cab237-57fe-4ecb-aba7-a1827f4ecdbe {{(pid=74646) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 16:16:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:48 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:16:48 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:16:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:48 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Deleted allocations for instance 508f43f1-6d5c-41ed-9e4f-06eec0bc992e
Oct 26 16:16:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c0b9f1b8-b36f-4e00-8cd0-87725da211ed tempest-TestShelveInstance-48608582 tempest-TestShelveInstance-48608582-project-member] Lock "508f43f1-6d5c-41ed-9e4f-06eec0bc992e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.320s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:49 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2bc4a961-4a5f-4477-8603-823adb496736 is timed out.
Oct 26 16:16:49 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Successfully detached device vdb from instance 2bc4a961-4a5f-4477-8603-823adb496736 from the live domain config.
Oct 26 16:16:49 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xMNEqoXa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:16:49 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e3632c-17a6-44aa-b869-3dcb978cfc23]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:16:49 user nova-compute[74646]: No targets found.
Oct 26 16:16:49 user nova-compute[74646]: iSNS:
Oct 26 16:16:49 user nova-compute[74646]: No targets found.
Oct 26 16:16:49 user nova-compute[74646]: STATIC:
Oct 26 16:16:49 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca
Oct 26 16:16:49 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:16:49 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:16:49 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89
Oct 26 16:16:49 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:16:49 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:16:49 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:16:49 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:16:49 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:16:49 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c
Oct 26 16:16:49 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:16:49 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:16:49 user nova-compute[74646]: FIRMWARE:
Oct 26 16:16:49 user nova-compute[74646]: No targets found.
Oct 26 16:16:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:16:49 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:16:49 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfea380-441e-48c9-a765-cf9f6aecfe4c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c9d840-d27b-45a7-9a2d-d32419bab17e]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:16:49 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:16:49 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:16:49 user nova-compute[74646]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:16:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:16:49 user nova-compute[74646]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca (non-flash)
Oct 26 16:16:49 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:16:49 user nova-compute[74646]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:16:49 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e8562cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca'): ({'sdd'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Removing single pathed devices sdd {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bbe3b5-0d05-4866-b9af-eecdabc4dc8e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4204b5-2ef5-4fb2-8b9d-9fdc51bca8ce]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Flushing IO for device /dev/sdd {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e713dbc-289d-4675-8ba8-1ad3323da147]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7095f81-29e7-4dba-9468-645499dc7f52]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d265fb6-0df9-4302-a7a9-3350b2eabda6]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:49 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3381e8d-8213-45c4-a27e-75d97c3f02e2]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca, portal: 172.16.0.220,3260]
Oct 26 16:16:50 user nova-compute[74646]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca, portal: 172.16.0.220,3260] successful.
Oct 26 16:16:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:16:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5d47359-f8a6-4aaf-a397-96255274e2ca -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:16:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb65456-96c0-43ec-b3fa-bed488a052d7]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:16:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:16:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:16:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] <== disconnect_volume: return (302ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:16:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:16:50 user nova-compute[74646]: DEBUG nova.objects.instance [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lazy-loading 'flavor' on Instance uuid 2bc4a961-4a5f-4477-8603-823adb496736 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:16:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-84543d4d-474d-4c16-bd94-7a9241ece55c tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "2bc4a961-4a5f-4477-8603-823adb496736" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.716s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "511f84be-7779-4856-8611-9171c1b59d58" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "511f84be-7779-4856-8611-9171c1b59d58" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "511f84be-7779-4856-8611-9171c1b59d58-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "511f84be-7779-4856-8611-9171c1b59d58-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "511f84be-7779-4856-8611-9171c1b59d58-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:58 user nova-compute[74646]: INFO nova.compute.manager [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Terminating instance
Oct 26 16:16:58 user nova-compute[74646]: DEBUG nova.compute.manager [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-e4e73228-98e2-4aa2-8fd4-6a53654ae7c4 req-2708bd3f-32e9-435b-ab45-af775d4d7c9e service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Received event network-vif-unplugged-948b856f-3b22-4614-96ca-7349cf1b9343 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e4e73228-98e2-4aa2-8fd4-6a53654ae7c4 req-2708bd3f-32e9-435b-ab45-af775d4d7c9e service nova] Acquiring lock "511f84be-7779-4856-8611-9171c1b59d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e4e73228-98e2-4aa2-8fd4-6a53654ae7c4 req-2708bd3f-32e9-435b-ab45-af775d4d7c9e service nova] Lock "511f84be-7779-4856-8611-9171c1b59d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-e4e73228-98e2-4aa2-8fd4-6a53654ae7c4 req-2708bd3f-32e9-435b-ab45-af775d4d7c9e service nova] Lock "511f84be-7779-4856-8611-9171c1b59d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-e4e73228-98e2-4aa2-8fd4-6a53654ae7c4 req-2708bd3f-32e9-435b-ab45-af775d4d7c9e service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] No waiting events found dispatching network-vif-unplugged-948b856f-3b22-4614-96ca-7349cf1b9343 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-e4e73228-98e2-4aa2-8fd4-6a53654ae7c4 req-2708bd3f-32e9-435b-ab45-af775d4d7c9e service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Received event network-vif-unplugged-948b856f-3b22-4614-96ca-7349cf1b9343 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:59 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Instance destroyed successfully.
Oct 26 16:16:59 user nova-compute[74646]: DEBUG nova.objects.instance [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'resources' on Instance uuid 511f84be-7779-4856-8611-9171c1b59d58 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:07:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2124447205',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2124447205',id=32,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:07:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90e848952345455183c15fee816b6f12',ramdisk_id='',reservation_id='r-y1v6qy1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-580785668',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:09:33Z,user_data=None,user_id='abd7a869c235467ca4da99867c6bc0d4',uuid=511f84be-7779-4856-8611-9171c1b59d58,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "948b856f-3b22-4614-96ca-7349cf1b9343", "address": "fa:16:3e:db:bd:9d", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b856f-3b", "ovs_interfaceid": "948b856f-3b22-4614-96ca-7349cf1b9343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converting VIF {"id": "948b856f-3b22-4614-96ca-7349cf1b9343", "address": "fa:16:3e:db:bd:9d", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap948b856f-3b", "ovs_interfaceid": "948b856f-3b22-4614-96ca-7349cf1b9343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:db:bd:9d,bridge_name='br-int',has_traffic_filtering=True,id=948b856f-3b22-4614-96ca-7349cf1b9343,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948b856f-3b') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG os_vif [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:bd:9d,bridge_name='br-int',has_traffic_filtering=True,id=948b856f-3b22-4614-96ca-7349cf1b9343,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948b856f-3b') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap948b856f-3b, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=114bb32f-b59b-44b4-8d13-dfed247b95ad) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:16:59 user nova-compute[74646]: INFO os_vif [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:db:bd:9d,bridge_name='br-int',has_traffic_filtering=True,id=948b856f-3b22-4614-96ca-7349cf1b9343,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap948b856f-3b')
Oct 26 16:16:59 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Deleting instance files /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58_del
Oct 26 16:16:59 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Deletion of /opt/stack/data/nova/instances/511f84be-7779-4856-8611-9171c1b59d58_del complete
Oct 26 16:16:59 user nova-compute[74646]: INFO nova.compute.manager [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Took 0.74 seconds to destroy the instance on the hypervisor.
Oct 26 16:16:59 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 511f84be-7779-4856-8611-9171c1b59d58] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:16:59 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Took 0.56 seconds to deallocate network for instance.
Oct 26 16:16:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-5f42cbc7-7c4f-493b-8374-0bc93384d264 req-704c8df5-3ccd-4955-9d96-04439b74a737 service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Received event network-vif-deleted-948b856f-3b22-4614-96ca-7349cf1b9343 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:16:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:00 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:17:00 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:17:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:00 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Deleted allocations for instance 511f84be-7779-4856-8611-9171c1b59d58
Oct 26 16:17:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-f0856647-d9fe-4a8e-ab4f-f3db80426d1e tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "511f84be-7779-4856-8611-9171c1b59d58" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.792s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-68c136ec-42bc-4ffd-bab7-e58359446125 req-e353bd89-7470-4baf-ac9c-2fbf2685df65 service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Received event network-vif-plugged-948b856f-3b22-4614-96ca-7349cf1b9343 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:17:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-68c136ec-42bc-4ffd-bab7-e58359446125 req-e353bd89-7470-4baf-ac9c-2fbf2685df65 service nova] Acquiring lock "511f84be-7779-4856-8611-9171c1b59d58-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-68c136ec-42bc-4ffd-bab7-e58359446125 req-e353bd89-7470-4baf-ac9c-2fbf2685df65 service nova] Lock "511f84be-7779-4856-8611-9171c1b59d58-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-68c136ec-42bc-4ffd-bab7-e58359446125 req-e353bd89-7470-4baf-ac9c-2fbf2685df65 service nova] Lock "511f84be-7779-4856-8611-9171c1b59d58-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-68c136ec-42bc-4ffd-bab7-e58359446125 req-e353bd89-7470-4baf-ac9c-2fbf2685df65 service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] No waiting events found dispatching network-vif-plugged-948b856f-3b22-4614-96ca-7349cf1b9343 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:17:00 user nova-compute[74646]: WARNING nova.compute.manager [req-68c136ec-42bc-4ffd-bab7-e58359446125 req-e353bd89-7470-4baf-ac9c-2fbf2685df65 service nova] [instance: 511f84be-7779-4856-8611-9171c1b59d58] Received unexpected event network-vif-plugged-948b856f-3b22-4614-96ca-7349cf1b9343 for instance with vm_state deleted and task_state None.
Oct 26 16:17:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:17:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:04 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:17:04 user nova-compute[74646]: INFO nova.compute.claims [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Claim successful on node user
Oct 26 16:17:04 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:17:04 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:17:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:17:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:17:04 user nova-compute[74646]: DEBUG nova.network.neutron [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:17:04 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:17:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG nova.policy [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9419f9603ca647269ed1cf42e233507f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a984c8da90ff476191cd5aa5787032c1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:17:05 user nova-compute[74646]: INFO nova.virt.block_device [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Booting with volume cf6809fa-dcdc-4421-b6d3-a604072b1ff6 at /dev/vda
Oct 26 16:17:05 user nova-compute[74646]: DEBUG os_brick.utils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[df667282-3c7c-473e-9f4b-ba07b07293b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e12ca69-6f96-4325-9efc-3fa49934cb44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[6077daba-679a-4ee6-90d1-ac4b32d979ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3af6b42-a063-47af-b5ce-8e67b6c3a853]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:17:05 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:17:05 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cd8d64-4cec-417c-8c91-587e90eea8d7]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG os_brick.utils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Updating existing volume attachment record: 0e3638c9-d176-4464-906f-9ce07ef413ce {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:17:05 user nova-compute[74646]: DEBUG nova.network.neutron [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Successfully created port: 89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:17:06 user nova-compute[74646]: DEBUG nova.network.neutron [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Successfully updated port: 89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:17:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "refresh_cache-4ad85ba6-d405-4bdb-b982-0ebf75ccb107" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:17:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquired lock "refresh_cache-4ad85ba6-d405-4bdb-b982-0ebf75ccb107" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:17:06 user nova-compute[74646]: DEBUG nova.network.neutron [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:17:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-3626e216-346f-47d5-8294-05348896b20b req-2e5f8e7b-4f75-4c77-b9fd-6382dab879f1 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Received event network-changed-89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:17:06 user nova-compute[74646]: DEBUG nova.compute.manager [req-3626e216-346f-47d5-8294-05348896b20b req-2e5f8e7b-4f75-4c77-b9fd-6382dab879f1 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Refreshing instance network info cache due to event network-changed-89be41e6-27b0-4d07-9bb3-42ac2f79c7be. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:17:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3626e216-346f-47d5-8294-05348896b20b req-2e5f8e7b-4f75-4c77-b9fd-6382dab879f1 service nova] Acquiring lock "refresh_cache-4ad85ba6-d405-4bdb-b982-0ebf75ccb107" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:17:06 user nova-compute[74646]: DEBUG nova.network.neutron [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:17:06 user nova-compute[74646]: DEBUG nova.network.neutron [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Updating instance_info_cache with network_info: [{"id": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "address": "fa:16:3e:1d:c4:ce", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89be41e6-27", "ovs_interfaceid": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:17:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Releasing lock "refresh_cache-4ad85ba6-d405-4bdb-b982-0ebf75ccb107" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:17:06 user nova-compute[74646]: DEBUG nova.compute.manager [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Instance network_info: |[{"id": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "address": "fa:16:3e:1d:c4:ce", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89be41e6-27", "ovs_interfaceid": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:17:06 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3626e216-346f-47d5-8294-05348896b20b req-2e5f8e7b-4f75-4c77-b9fd-6382dab879f1 service nova] Acquired lock "refresh_cache-4ad85ba6-d405-4bdb-b982-0ebf75ccb107" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:17:06 user nova-compute[74646]: DEBUG nova.network.neutron [req-3626e216-346f-47d5-8294-05348896b20b req-2e5f8e7b-4f75-4c77-b9fd-6382dab879f1 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Refreshing network info cache for port 89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:17:07 user nova-compute[74646]: DEBUG nova.network.neutron [req-3626e216-346f-47d5-8294-05348896b20b req-2e5f8e7b-4f75-4c77-b9fd-6382dab879f1 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Updated VIF entry in instance network info cache for port 89be41e6-27b0-4d07-9bb3-42ac2f79c7be. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:17:07 user nova-compute[74646]: DEBUG nova.network.neutron [req-3626e216-346f-47d5-8294-05348896b20b req-2e5f8e7b-4f75-4c77-b9fd-6382dab879f1 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Updating instance_info_cache with network_info: [{"id": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "address": "fa:16:3e:1d:c4:ce", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89be41e6-27", "ovs_interfaceid": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:17:07 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3626e216-346f-47d5-8294-05348896b20b req-2e5f8e7b-4f75-4c77-b9fd-6382dab879f1 service nova] Releasing lock "refresh_cache-4ad85ba6-d405-4bdb-b982-0ebf75ccb107" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:17:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "2bc4a961-4a5f-4477-8603-823adb496736" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "2bc4a961-4a5f-4477-8603-823adb496736" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "2bc4a961-4a5f-4477-8603-823adb496736-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "2bc4a961-4a5f-4477-8603-823adb496736-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "2bc4a961-4a5f-4477-8603-823adb496736-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:19 user nova-compute[74646]: INFO nova.compute.manager [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Terminating instance
Oct 26 16:17:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-1c912c76-e6f3-4ba3-862e-3674570a4e09 req-70d04f3e-c41a-4b35-8223-b8ebf4c72d3e service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Received event network-vif-unplugged-7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1c912c76-e6f3-4ba3-862e-3674570a4e09 req-70d04f3e-c41a-4b35-8223-b8ebf4c72d3e service nova] Acquiring lock "2bc4a961-4a5f-4477-8603-823adb496736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1c912c76-e6f3-4ba3-862e-3674570a4e09 req-70d04f3e-c41a-4b35-8223-b8ebf4c72d3e service nova] Lock "2bc4a961-4a5f-4477-8603-823adb496736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1c912c76-e6f3-4ba3-862e-3674570a4e09 req-70d04f3e-c41a-4b35-8223-b8ebf4c72d3e service nova] Lock "2bc4a961-4a5f-4477-8603-823adb496736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-1c912c76-e6f3-4ba3-862e-3674570a4e09 req-70d04f3e-c41a-4b35-8223-b8ebf4c72d3e service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] No waiting events found dispatching network-vif-unplugged-7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:17:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-1c912c76-e6f3-4ba3-862e-3674570a4e09 req-70d04f3e-c41a-4b35-8223-b8ebf4c72d3e service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Received event network-vif-unplugged-7344b2ea-bf85-4757-af64-b1b1a6f70c6f for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:17:20 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Instance destroyed successfully.
Oct 26 16:17:20 user nova-compute[74646]: DEBUG nova.objects.instance [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lazy-loading 'resources' on Instance uuid 2bc4a961-4a5f-4477-8603-823adb496736 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:17:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-26792070',display_name='tempest-AttachVolumeNegativeTest-server-26792070',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-26792070',id=37,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHpBC8LDsMQ5R5y4zYW5ywpBiYTotUCG3noYuVyt3OFFTT2Pghdzfy9WQxZaYwfyKwigbUJ+lEqg7R1Mx+RT9B/aDasZxHJfbUfPZKmDjF8VZ0hbK79n8+sCHM+CtQ6prQ==',key_name='tempest-keypair-833234407',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:11:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f24b251085ed49c991eef6c2df0b0990',ramdisk_id='',reservation_id='r-g6peo3v0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-340789388',owner_user_name='tempest-AttachVolumeNegativeTest-340789388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:11:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41c8a2a8c5594cca9451ab93e681dcd0',uuid=2bc4a961-4a5f-4477-8603-823adb496736,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "address": "fa:16:3e:1c:5e:22", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7344b2ea-bf", "ovs_interfaceid": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:17:20 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converting VIF {"id": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "address": "fa:16:3e:1c:5e:22", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7344b2ea-bf", "ovs_interfaceid": "7344b2ea-bf85-4757-af64-b1b1a6f70c6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:17:20 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1c:5e:22,bridge_name='br-int',has_traffic_filtering=True,id=7344b2ea-bf85-4757-af64-b1b1a6f70c6f,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7344b2ea-bf') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:17:20 user nova-compute[74646]: DEBUG os_vif [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:5e:22,bridge_name='br-int',has_traffic_filtering=True,id=7344b2ea-bf85-4757-af64-b1b1a6f70c6f,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7344b2ea-bf') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:17:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7344b2ea-bf, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:17:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:17:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=511d5393-49dc-4e5a-a9f2-87a72b7bf031) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:17:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:17:20 user nova-compute[74646]: INFO os_vif [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1c:5e:22,bridge_name='br-int',has_traffic_filtering=True,id=7344b2ea-bf85-4757-af64-b1b1a6f70c6f,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7344b2ea-bf')
Oct 26 16:17:20 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Deleting instance files /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736_del
Oct 26 16:17:20 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Deletion of /opt/stack/data/nova/instances/2bc4a961-4a5f-4477-8603-823adb496736_del complete
Oct 26 16:17:20 user nova-compute[74646]: INFO nova.compute.manager [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 26 16:17:20 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:17:20 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:17:20 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:17:21 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:17:21 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Took 0.66 seconds to deallocate network for instance.
Oct 26 16:17:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:21 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:17:21 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:17:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:21 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Deleted allocations for instance 2bc4a961-4a5f-4477-8603-823adb496736
Oct 26 16:17:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-bd5a7331-4e12-47c5-b7f0-4e7f15141a4f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "2bc4a961-4a5f-4477-8603-823adb496736" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.925s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-26cd056b-ab8d-419a-a30d-5d0c9ee61ef8 req-4252086a-102e-4913-bab5-9d056588e750 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Received event network-vif-plugged-7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:17:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-26cd056b-ab8d-419a-a30d-5d0c9ee61ef8 req-4252086a-102e-4913-bab5-9d056588e750 service nova] Acquiring lock "2bc4a961-4a5f-4477-8603-823adb496736-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-26cd056b-ab8d-419a-a30d-5d0c9ee61ef8 req-4252086a-102e-4913-bab5-9d056588e750 service nova] Lock "2bc4a961-4a5f-4477-8603-823adb496736-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-26cd056b-ab8d-419a-a30d-5d0c9ee61ef8 req-4252086a-102e-4913-bab5-9d056588e750 service nova] Lock "2bc4a961-4a5f-4477-8603-823adb496736-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-26cd056b-ab8d-419a-a30d-5d0c9ee61ef8 req-4252086a-102e-4913-bab5-9d056588e750 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] No waiting events found dispatching network-vif-plugged-7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:17:22 user nova-compute[74646]: WARNING nova.compute.manager [req-26cd056b-ab8d-419a-a30d-5d0c9ee61ef8 req-4252086a-102e-4913-bab5-9d056588e750 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Received unexpected event network-vif-plugged-7344b2ea-bf85-4757-af64-b1b1a6f70c6f for instance with vm_state deleted and task_state None.
Oct 26 16:17:22 user nova-compute[74646]: DEBUG nova.compute.manager [req-26cd056b-ab8d-419a-a30d-5d0c9ee61ef8 req-4252086a-102e-4913-bab5-9d056588e750 service nova] [instance: 2bc4a961-4a5f-4477-8603-823adb496736] Received event network-vif-deleted-7344b2ea-bf85-4757-af64-b1b1a6f70c6f {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.compute.manager [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:17:23 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Creating image(s)
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Ensure instance console log exists: /opt/stack/data/nova/instances/4ad85ba6-d405-4bdb-b982-0ebf75ccb107/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Start _get_guest_xml network_info=[{"id": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "address": "fa:16:3e:1d:c4:ce", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89be41e6-27", "ovs_interfaceid": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': '0e3638c9-d176-4464-906f-9ce07ef413ce', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ValHwUWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4ad85ba6-d405-4bdb-b982-0ebf75ccb107', 'attached_at': '', 'detached_at': '', 'volume_id': 'cf6809fa-dcdc-4421-b6d3-a604072b1ff6', 'serial': 'cf6809fa-dcdc-4421-b6d3-a604072b1ff6'}, 'disk_bus': 'virtio', 'delete_on_termination': False, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:17:23 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:17:23 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ValHwUWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:17:23 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:17:23 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:17:23 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e624d8bb-c6fe-4772-b15e-85229699272b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:17:23 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d48cc6d-7be4-4ef4-9db7-32d0267db302]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6] added
Oct 26 16:17:23 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2f877d-c1b3-4856-8d59-c351f6cbf362]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[390e5528-05e2-4349-95c7-268ae6d14eb1]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ValHwUWS {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ValHwUWS" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6c2ac3-ab59-4396-875e-02f95025675d]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ValHwUWS'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[607bfe6d-de62-4f13-95dc-312e3179d076]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8359121-45d0-4497-91bf-7048fd949519]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:17:23 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:17:23 user nova-compute[74646]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:17:23 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:17:23 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:17:23 user nova-compute[74646]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:17:23 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d231dfab-ac61-4053-bdbc-aabd0fe12681]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6, portal: 172.16.0.220,3260]
Oct 26 16:17:23 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6, portal: 172.16.0.220,3260] successful.
Oct 26 16:17:23 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fdd5e6-bbe9-4cb0-b32a-c4bf2caab93b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[005bf0fd-fd3e-473c-9d67-9ca519b1f7f8]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:17:23 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:17:23 user nova-compute[74646]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:17:23 user nova-compute[74646]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)
Oct 26 16:17:23 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:17:23 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:17:23 user nova-compute[74646]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:17:23 user nova-compute[74646]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)
Oct 26 16:17:23 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.259s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7b2b4c-4e2f-42bb-89cb-afdf33099a07]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:23 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: None {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ValHwUWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23033353163666566', 'path': '/dev/sdd'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033353163666566', 'path': '/dev/sdd'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1938256860',display_name='tempest-TestVolumeBootPattern-server-1938256860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1938256860',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcrhPEoRoaB0ki3RmOaZ3eTquho7+8b0QqO8Voy8+ev28RwRqncTnJ8yqJ/AeeNTkufE9hPbEWGpSzdo215+QWyfPE53vOWOtQaI8OQeut+svp088xcotWDN6W4cNUpMQ==',key_name='tempest-TestVolumeBootPattern-371467899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-4c3jbjh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:17:05Z,user_data=None,user_id='9419f9603ca647269ed1cf42e233507f',uuid=4ad85ba6-d405-4bdb-b982-0ebf75ccb107,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "address": "fa:16:3e:1d:c4:ce", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89be41e6-27", "ovs_interfaceid": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "address": "fa:16:3e:1d:c4:ce", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89be41e6-27", "ovs_interfaceid": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:c4:ce,bridge_name='br-int',has_traffic_filtering=True,id=89be41e6-27b0-4d07-9bb3-42ac2f79c7be,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89be41e6-27') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG nova.objects.instance [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ad85ba6-d405-4bdb-b982-0ebf75ccb107 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:17:24 user nova-compute[74646]:   <uuid>4ad85ba6-d405-4bdb-b982-0ebf75ccb107</uuid>
Oct 26 16:17:24 user nova-compute[74646]:   <name>instance-0000002a</name>
Oct 26 16:17:24 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:17:24 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:17:24 user nova-compute[74646]:   <metadata>
Oct 26 16:17:24 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:17:24 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:17:24 user nova-compute[74646]:       <nova:name>tempest-TestVolumeBootPattern-server-1938256860</nova:name>
Oct 26 16:17:24 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:17:23</nova:creationTime>
Oct 26 16:17:24 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:17:24 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:17:24 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:17:24 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:17:24 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:17:24 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:17:24 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:17:24 user nova-compute[74646]:       <nova:owner>
Oct 26 16:17:24 user nova-compute[74646]:         <nova:user uuid="9419f9603ca647269ed1cf42e233507f">tempest-TestVolumeBootPattern-1231840017-project-member</nova:user>
Oct 26 16:17:24 user nova-compute[74646]:         <nova:project uuid="a984c8da90ff476191cd5aa5787032c1">tempest-TestVolumeBootPattern-1231840017</nova:project>
Oct 26 16:17:24 user nova-compute[74646]:       </nova:owner>
Oct 26 16:17:24 user nova-compute[74646]:       <nova:ports>
Oct 26 16:17:24 user nova-compute[74646]:         <nova:port uuid="89be41e6-27b0-4d07-9bb3-42ac2f79c7be">
Oct 26 16:17:24 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 26 16:17:24 user nova-compute[74646]:         </nova:port>
Oct 26 16:17:24 user nova-compute[74646]:       </nova:ports>
Oct 26 16:17:24 user nova-compute[74646]:     </nova:instance>
Oct 26 16:17:24 user nova-compute[74646]:   </metadata>
Oct 26 16:17:24 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:17:24 user nova-compute[74646]:     <system>
Oct 26 16:17:24 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:17:24 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:17:24 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:17:24 user nova-compute[74646]:       <entry name="serial">4ad85ba6-d405-4bdb-b982-0ebf75ccb107</entry>
Oct 26 16:17:24 user nova-compute[74646]:       <entry name="uuid">4ad85ba6-d405-4bdb-b982-0ebf75ccb107</entry>
Oct 26 16:17:24 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:17:24 user nova-compute[74646]:     </system>
Oct 26 16:17:24 user nova-compute[74646]:   </sysinfo>
Oct 26 16:17:24 user nova-compute[74646]:   <os>
Oct 26 16:17:24 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:17:24 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:17:24 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:17:24 user nova-compute[74646]:   </os>
Oct 26 16:17:24 user nova-compute[74646]:   <features>
Oct 26 16:17:24 user nova-compute[74646]:     <acpi/>
Oct 26 16:17:24 user nova-compute[74646]:     <apic/>
Oct 26 16:17:24 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:17:24 user nova-compute[74646]:   </features>
Oct 26 16:17:24 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:17:24 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:17:24 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:17:24 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:17:24 user nova-compute[74646]:   </clock>
Oct 26 16:17:24 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:17:24 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:17:24 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:17:24 user nova-compute[74646]:   </cpu>
Oct 26 16:17:24 user nova-compute[74646]:   <devices>
Oct 26 16:17:24 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:17:24 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:17:24 user nova-compute[74646]:       <source dev="/dev/sdd"/>
Oct 26 16:17:24 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:17:24 user nova-compute[74646]:       <serial>cf6809fa-dcdc-4421-b6d3-a604072b1ff6</serial>
Oct 26 16:17:24 user nova-compute[74646]:     </disk>
Oct 26 16:17:24 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:17:24 user nova-compute[74646]:       <mac address="fa:16:3e:1d:c4:ce"/>
Oct 26 16:17:24 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:17:24 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:17:24 user nova-compute[74646]:       <target dev="tap89be41e6-27"/>
Oct 26 16:17:24 user nova-compute[74646]:     </interface>
Oct 26 16:17:24 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:17:24 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/4ad85ba6-d405-4bdb-b982-0ebf75ccb107/console.log" append="off"/>
Oct 26 16:17:24 user nova-compute[74646]:     </serial>
Oct 26 16:17:24 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:17:24 user nova-compute[74646]:     <video>
Oct 26 16:17:24 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:17:24 user nova-compute[74646]:     </video>
Oct 26 16:17:24 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:17:24 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:17:24 user nova-compute[74646]:     </rng>
Oct 26 16:17:24 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:17:24 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:17:24 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:17:24 user nova-compute[74646]:     </memballoon>
Oct 26 16:17:24 user nova-compute[74646]:   </devices>
Oct 26 16:17:24 user nova-compute[74646]: </domain>
Oct 26 16:17:24 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1938256860',display_name='tempest-TestVolumeBootPattern-server-1938256860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1938256860',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcrhPEoRoaB0ki3RmOaZ3eTquho7+8b0QqO8Voy8+ev28RwRqncTnJ8yqJ/AeeNTkufE9hPbEWGpSzdo215+QWyfPE53vOWOtQaI8OQeut+svp088xcotWDN6W4cNUpMQ==',key_name='tempest-TestVolumeBootPattern-371467899',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-4c3jbjh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:17:05Z,user_data=None,user_id='9419f9603ca647269ed1cf42e233507f',uuid=4ad85ba6-d405-4bdb-b982-0ebf75ccb107,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "address": "fa:16:3e:1d:c4:ce", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89be41e6-27", "ovs_interfaceid": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "address": "fa:16:3e:1d:c4:ce", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89be41e6-27", "ovs_interfaceid": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:c4:ce,bridge_name='br-int',has_traffic_filtering=True,id=89be41e6-27b0-4d07-9bb3-42ac2f79c7be,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89be41e6-27') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG os_vif [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:c4:ce,bridge_name='br-int',has_traffic_filtering=True,id=89be41e6-27b0-4d07-9bb3-42ac2f79c7be,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89be41e6-27') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9cd6abd7-ea4f-5a87-818a-bc2d09a59a47', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89be41e6-27, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap89be41e6-27, col_values=(('qos', UUID('ff26febf-3ea5-422a-a397-2cb3a133a874')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap89be41e6-27, col_values=(('external_ids', {'iface-id': '89be41e6-27b0-4d07-9bb3-42ac2f79c7be', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:c4:ce', 'vm-uuid': '4ad85ba6-d405-4bdb-b982-0ebf75ccb107'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:17:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:24 user nova-compute[74646]: INFO os_vif [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:c4:ce,bridge_name='br-int',has_traffic_filtering=True,id=89be41e6-27b0-4d07-9bb3-42ac2f79c7be,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89be41e6-27')
Oct 26 16:17:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:17:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] No VIF found with MAC fa:16:3e:1d:c4:ce, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:17:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-33455f73-4940-4c39-93cd-c72409a3f69b req-d01cb984-364b-42b5-beff-aaa2eb51c8b9 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Received event network-vif-plugged-89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:17:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-33455f73-4940-4c39-93cd-c72409a3f69b req-d01cb984-364b-42b5-beff-aaa2eb51c8b9 service nova] Acquiring lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-33455f73-4940-4c39-93cd-c72409a3f69b req-d01cb984-364b-42b5-beff-aaa2eb51c8b9 service nova] Lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-33455f73-4940-4c39-93cd-c72409a3f69b req-d01cb984-364b-42b5-beff-aaa2eb51c8b9 service nova] Lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-33455f73-4940-4c39-93cd-c72409a3f69b req-d01cb984-364b-42b5-beff-aaa2eb51c8b9 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] No waiting events found dispatching network-vif-plugged-89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:17:26 user nova-compute[74646]: WARNING nova.compute.manager [req-33455f73-4940-4c39-93cd-c72409a3f69b req-d01cb984-364b-42b5-beff-aaa2eb51c8b9 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Received unexpected event network-vif-plugged-89be41e6-27b0-4d07-9bb3-42ac2f79c7be for instance with vm_state building and task_state spawning.
Oct 26 16:17:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:28 user nova-compute[74646]: DEBUG nova.compute.manager [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:17:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:17:28 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Instance spawned successfully.
Oct 26 16:17:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:17:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:17:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:17:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:17:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:17:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:17:28 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:17:28 user nova-compute[74646]: INFO nova.compute.manager [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Took 4.81 seconds to spawn the instance on the hypervisor.
Oct 26 16:17:28 user nova-compute[74646]: DEBUG nova.compute.manager [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:17:28 user nova-compute[74646]: DEBUG nova.compute.manager [req-f5268f77-2e9f-4c00-8b3d-ff7a20aa0de4 req-64b2096d-30df-4632-9bac-48401591d79c service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Received event network-vif-plugged-89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:17:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f5268f77-2e9f-4c00-8b3d-ff7a20aa0de4 req-64b2096d-30df-4632-9bac-48401591d79c service nova] Acquiring lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f5268f77-2e9f-4c00-8b3d-ff7a20aa0de4 req-64b2096d-30df-4632-9bac-48401591d79c service nova] Lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f5268f77-2e9f-4c00-8b3d-ff7a20aa0de4 req-64b2096d-30df-4632-9bac-48401591d79c service nova] Lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:28 user nova-compute[74646]: DEBUG nova.compute.manager [req-f5268f77-2e9f-4c00-8b3d-ff7a20aa0de4 req-64b2096d-30df-4632-9bac-48401591d79c service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] No waiting events found dispatching network-vif-plugged-89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:17:28 user nova-compute[74646]: WARNING nova.compute.manager [req-f5268f77-2e9f-4c00-8b3d-ff7a20aa0de4 req-64b2096d-30df-4632-9bac-48401591d79c service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Received unexpected event network-vif-plugged-89be41e6-27b0-4d07-9bb3-42ac2f79c7be for instance with vm_state building and task_state spawning.
Oct 26 16:17:28 user nova-compute[74646]: INFO nova.compute.manager [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Took 23.97 seconds to build instance.
Oct 26 16:17:28 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-045b4abc-8b38-417b-b158-7e2306dfd813 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.081s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:29 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:34 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:36 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:17:37 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:17:37 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:17:37 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:17:37 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:17:38 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Didn't find any instances for network info cache update. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:39 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:40 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:17:40 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:17:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8403MB free_disk=25.219268798828125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 1283575f-b614-42d5-b632-c1409f295207 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance fa8813a4-be8c-452a-8d2d-a5fd972c2498 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance dd13d851-9338-4811-b48f-06c719844358 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance ed415bf2-5b3a-4b37-b069-7d206f0d6700 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 4ad85ba6-d405-4bdb-b982-0ebf75ccb107 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:41 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:17:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:45 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:17:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:47 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:49 user nova-compute[74646]: INFO nova.compute.manager [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Terminating instance
Oct 26 16:17:49 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG nova.compute.manager [req-da141127-03e3-4ba1-95da-dc659dea1840 req-0c17dfc3-46df-4f5f-86fe-407c3fa448d7 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-vif-unplugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da141127-03e3-4ba1-95da-dc659dea1840 req-0c17dfc3-46df-4f5f-86fe-407c3fa448d7 service nova] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da141127-03e3-4ba1-95da-dc659dea1840 req-0c17dfc3-46df-4f5f-86fe-407c3fa448d7 service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-da141127-03e3-4ba1-95da-dc659dea1840 req-0c17dfc3-46df-4f5f-86fe-407c3fa448d7 service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG nova.compute.manager [req-da141127-03e3-4ba1-95da-dc659dea1840 req-0c17dfc3-46df-4f5f-86fe-407c3fa448d7 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] No waiting events found dispatching network-vif-unplugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG nova.compute.manager [req-da141127-03e3-4ba1-95da-dc659dea1840 req-0c17dfc3-46df-4f5f-86fe-407c3fa448d7 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-vif-unplugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:17:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Instance destroyed successfully.
Oct 26 16:17:50 user nova-compute[74646]: DEBUG nova.objects.instance [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'resources' on Instance uuid fa8813a4-be8c-452a-8d2d-a5fd972c2498 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-946523720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-946523720',id=25,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:04:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90e848952345455183c15fee816b6f12',ramdisk_id='',reservation_id='r-qkm6r2ju',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-580785668',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:05:49Z,user_data=None,user_id='abd7a869c235467ca4da99867c6bc0d4',uuid=fa8813a4-be8c-452a-8d2d-a5fd972c2498,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converting VIF {"id": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "address": "fa:16:3e:05:f0:c8", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa15cdcab-84", "ovs_interfaceid": "a15cdcab-84af-42b2-bf76-a1c3027ee207", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:f0:c8,bridge_name='br-int',has_traffic_filtering=True,id=a15cdcab-84af-42b2-bf76-a1c3027ee207,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cdcab-84') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_vif [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:f0:c8,bridge_name='br-int',has_traffic_filtering=True,id=a15cdcab-84af-42b2-bf76-a1c3027ee207,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cdcab-84') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa15cdcab-84, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=486c9504-e2f4-424d-93a8-0e5661d4b60f) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:50 user nova-compute[74646]: INFO os_vif [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:f0:c8,bridge_name='br-int',has_traffic_filtering=True,id=a15cdcab-84af-42b2-bf76-a1c3027ee207,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa15cdcab-84')
Oct 26 16:17:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZLeTDFiQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:17:50 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[32364905-5686-41da-a361-cd2a5d787584]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:17:50 user nova-compute[74646]: No targets found.
Oct 26 16:17:50 user nova-compute[74646]: iSNS:
Oct 26 16:17:50 user nova-compute[74646]: No targets found.
Oct 26 16:17:50 user nova-compute[74646]: STATIC:
Oct 26 16:17:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89
Oct 26 16:17:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:17:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:17:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6
Oct 26 16:17:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:17:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:17:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2
Oct 26 16:17:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:17:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:17:50 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c
Oct 26 16:17:50 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:17:50 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:17:50 user nova-compute[74646]: FIRMWARE:
Oct 26 16:17:50 user nova-compute[74646]: No targets found.
Oct 26 16:17:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:17:50 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:17:50 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be3c92c-1d3c-4e43-b1b4-b6f920ee6284]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e20eab-da7a-4ad2-b9d0-e14b2892a154]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:17:50 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:17:50 user nova-compute[74646]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:17:50 user nova-compute[74646]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)
Oct 26 16:17:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 (non-flash)
Oct 26 16:17:50 user nova-compute[74646]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:17:50 user nova-compute[74646]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:17:50 user nova-compute[74646]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)
Oct 26 16:17:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d05e8b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2'): ({'sde'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Removing single pathed devices sde {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac75ba6-d3d7-4b60-8197-8b29acc28a3c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6251b1-49fb-41cc-9c42-98db82602b8c]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Flushing IO for device /dev/sde {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4006d39-6f5c-48ff-b203-2bbbd35552f7]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.043s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd689dc-e07e-431d-82de-ae77a589e76f]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] SCSI volumes sde have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0a671e-39e1-44a8-a9ec-665510d6f56f]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[faaf5ecf-baa9-4f70-8d40-c6b8b16fb5c6]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2, portal: 172.16.0.220,3260]
Oct 26 16:17:50 user nova-compute[74646]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2, portal: 172.16.0.220,3260] successful.
Oct 26 16:17:50 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e9aa5f9-c63b-4493-b887-bc5455f9dee2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[193cc6db-1931-45b8-bf0d-c94c8ebc2fda]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] <== disconnect_volume: return (305ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:17:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Deleting instance files /opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498_del
Oct 26 16:17:50 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Deletion of /opt/stack/data/nova/instances/fa8813a4-be8c-452a-8d2d-a5fd972c2498_del complete
Oct 26 16:17:50 user nova-compute[74646]: INFO nova.compute.manager [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 26 16:17:50 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:17:50 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:17:50 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Took 0.38 seconds to deallocate network for instance.
Oct 26 16:17:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:51 user nova-compute[74646]: DEBUG nova.compute.manager [req-73738f1a-2b3b-4937-ae92-cd8c151f2378 req-25739d52-9542-43b9-9471-ce5b61820c71 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:17:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-73738f1a-2b3b-4937-ae92-cd8c151f2378 req-25739d52-9542-43b9-9471-ce5b61820c71 service nova] Acquiring lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-73738f1a-2b3b-4937-ae92-cd8c151f2378 req-25739d52-9542-43b9-9471-ce5b61820c71 service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-73738f1a-2b3b-4937-ae92-cd8c151f2378 req-25739d52-9542-43b9-9471-ce5b61820c71 service nova] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:51 user nova-compute[74646]: DEBUG nova.compute.manager [req-73738f1a-2b3b-4937-ae92-cd8c151f2378 req-25739d52-9542-43b9-9471-ce5b61820c71 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] No waiting events found dispatching network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:17:51 user nova-compute[74646]: WARNING nova.compute.manager [req-73738f1a-2b3b-4937-ae92-cd8c151f2378 req-25739d52-9542-43b9-9471-ce5b61820c71 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received unexpected event network-vif-plugged-a15cdcab-84af-42b2-bf76-a1c3027ee207 for instance with vm_state active and task_state deleting.
Oct 26 16:17:51 user nova-compute[74646]: DEBUG nova.compute.manager [req-73738f1a-2b3b-4937-ae92-cd8c151f2378 req-25739d52-9542-43b9-9471-ce5b61820c71 service nova] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Received event network-vif-deleted-a15cdcab-84af-42b2-bf76-a1c3027ee207 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:17:51 user nova-compute[74646]: INFO nova.compute.manager [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: fa8813a4-be8c-452a-8d2d-a5fd972c2498] Took 0.97 seconds to detach 1 volumes for instance.
Oct 26 16:17:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:17:51 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:17:52 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:17:52 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:17:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:52 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Deleted allocations for instance fa8813a4-be8c-452a-8d2d-a5fd972c2498
Oct 26 16:17:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ea938e21-49c3-4dad-b978-2d85ab69cf5b tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "fa8813a4-be8c-452a-8d2d-a5fd972c2498" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.023s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:17:55 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:17:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-1151848c-1390-44be-bf5d-4735ff5a3144 req-1127e74d-93db-4ea6-a2c0-6433687c5e5f service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-changed-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:17:59 user nova-compute[74646]: DEBUG nova.compute.manager [req-1151848c-1390-44be-bf5d-4735ff5a3144 req-1127e74d-93db-4ea6-a2c0-6433687c5e5f service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Refreshing instance network info cache due to event network-changed-26d80c0f-407c-453c-94b9-8a19b9a0b11e. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:17:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1151848c-1390-44be-bf5d-4735ff5a3144 req-1127e74d-93db-4ea6-a2c0-6433687c5e5f service nova] Acquiring lock "refresh_cache-ed415bf2-5b3a-4b37-b069-7d206f0d6700" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:17:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1151848c-1390-44be-bf5d-4735ff5a3144 req-1127e74d-93db-4ea6-a2c0-6433687c5e5f service nova] Acquired lock "refresh_cache-ed415bf2-5b3a-4b37-b069-7d206f0d6700" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:17:59 user nova-compute[74646]: DEBUG nova.network.neutron [req-1151848c-1390-44be-bf5d-4735ff5a3144 req-1127e74d-93db-4ea6-a2c0-6433687c5e5f service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Refreshing network info cache for port 26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:18:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-1151848c-1390-44be-bf5d-4735ff5a3144 req-1127e74d-93db-4ea6-a2c0-6433687c5e5f service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Updated VIF entry in instance network info cache for port 26d80c0f-407c-453c-94b9-8a19b9a0b11e. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:18:00 user nova-compute[74646]: DEBUG nova.network.neutron [req-1151848c-1390-44be-bf5d-4735ff5a3144 req-1127e74d-93db-4ea6-a2c0-6433687c5e5f service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Updating instance_info_cache with network_info: [{"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:18:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-1151848c-1390-44be-bf5d-4735ff5a3144 req-1127e74d-93db-4ea6-a2c0-6433687c5e5f service nova] Releasing lock "refresh_cache-ed415bf2-5b3a-4b37-b069-7d206f0d6700" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:18:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:00 user nova-compute[74646]: INFO nova.compute.manager [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Rebuilding instance
Oct 26 16:18:00 user nova-compute[74646]: DEBUG nova.compute.manager [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:18:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:00 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:01 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Instance destroyed successfully.
Oct 26 16:18:01 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Instance destroyed successfully.
Oct 26 16:18:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1909920837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-508729915',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0IqpbEUj9FTXwsltPcQQxE3mw3HOun3lOf6u+YSQ0CcyJV6/G/ONdi3SGnlhdvJqfyz0BhUnqVGVb/CKZrfcM/4Xw4szISMudN+QKZ31ox5/FMuTnBsO4uIsAc0O90zg==',key_name='tempest-keypair-341580469',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:16:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bffc92069c704c6fac59cda13fa72e52',ramdisk_id='',reservation_id='r-7wch87hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1491440656',owner_user_name='tempest-ServerActionsV293TestJSON-1491440656-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:18:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='726dd5eaa0cd45ada546ac68fe04ef40',uuid=ed415bf2-5b3a-4b37-b069-7d206f0d6700,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Converting VIF {"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:86,bridge_name='br-int',has_traffic_filtering=True,id=26d80c0f-407c-453c-94b9-8a19b9a0b11e,network=Network(e5675dc6-92c8-465e-a116-18c24d116464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26d80c0f-40') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_vif [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:86,bridge_name='br-int',has_traffic_filtering=True,id=26d80c0f-407c-453c-94b9-8a19b9a0b11e,network=Network(e5675dc6-92c8-465e-a116-18c24d116464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26d80c0f-40') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26d80c0f-40, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=816ef7ba-433d-4a2b-aef3-750ec9b87c98) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:01 user nova-compute[74646]: INFO os_vif [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:86,bridge_name='br-int',has_traffic_filtering=True,id=26d80c0f-407c-453c-94b9-8a19b9a0b11e,network=Network(e5675dc6-92c8-465e-a116-18c24d116464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26d80c0f-40')
Oct 26 16:18:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSmuCPNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:18:01 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-777e0016-9bc3-43c2-9ddc-3efbed9553e7 req-e827934e-6cc3-4ba0-bf64-9c19f9e52157 service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-unplugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-777e0016-9bc3-43c2-9ddc-3efbed9553e7 req-e827934e-6cc3-4ba0-bf64-9c19f9e52157 service nova] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-777e0016-9bc3-43c2-9ddc-3efbed9553e7 req-e827934e-6cc3-4ba0-bf64-9c19f9e52157 service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-777e0016-9bc3-43c2-9ddc-3efbed9553e7 req-e827934e-6cc3-4ba0-bf64-9c19f9e52157 service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG nova.compute.manager [req-777e0016-9bc3-43c2-9ddc-3efbed9553e7 req-e827934e-6cc3-4ba0-bf64-9c19f9e52157 service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] No waiting events found dispatching network-vif-unplugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:18:01 user nova-compute[74646]: WARNING nova.compute.manager [req-777e0016-9bc3-43c2-9ddc-3efbed9553e7 req-e827934e-6cc3-4ba0-bf64-9c19f9e52157 service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received unexpected event network-vif-unplugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e for instance with vm_state active and task_state rebuilding.
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbc7eb6-9832-4513-ae1e-b8a2fa6a1586]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:18:01 user nova-compute[74646]: No targets found.
Oct 26 16:18:01 user nova-compute[74646]: iSNS:
Oct 26 16:18:01 user nova-compute[74646]: No targets found.
Oct 26 16:18:01 user nova-compute[74646]: STATIC:
Oct 26 16:18:01 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89
Oct 26 16:18:01 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:18:01 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:18:01 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6
Oct 26 16:18:01 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:18:01 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:18:01 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c
Oct 26 16:18:01 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:18:01 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:18:01 user nova-compute[74646]: FIRMWARE:
Oct 26 16:18:01 user nova-compute[74646]: No targets found.
Oct 26 16:18:01 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:18:01 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:18:01 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2461bbd3-28bf-40d9-ae38-c0446d38b02e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa37ad7-ce2c-4004-b4ac-187b7b0da99d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:18:01 user nova-compute[74646]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:18:01 user nova-compute[74646]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)
Oct 26 16:18:01 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:18:01 user nova-compute[74646]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:18:01 user nova-compute[74646]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)
Oct 26 16:18:01 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e815caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c'): ({'sdb'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Removing single pathed devices sdb {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb080a11-3a92-474b-bae4-709c4e49e5f1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0e8495-ab2c-42c3-b64a-256e84000fcf]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Flushing IO for device /dev/sdb {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7099a16e-34dd-4206-813e-f8fe21d58f79]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[193fc610-e5f3-4560-81cf-74c5eb5f9903]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54d0be3-d656-456c-b2b8-8ec43deb81f7]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[950903d5-e4b9-466e-8a3c-245efe8db19d]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260]
Oct 26 16:18:01 user nova-compute[74646]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260] successful.
Oct 26 16:18:01 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fc9525-557f-466b-981f-f49cbceba36b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] <== disconnect_volume: return (355ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:18:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:18:01 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Deleting instance files /opt/stack/data/nova/instances/ed415bf2-5b3a-4b37-b069-7d206f0d6700_del
Oct 26 16:18:01 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Deletion of /opt/stack/data/nova/instances/ed415bf2-5b3a-4b37-b069-7d206f0d6700_del complete
Oct 26 16:18:02 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance ed415bf2-5b3a-4b37-b069-7d206f0d6700 could not be found.
Oct 26 16:18:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSmuCPNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:18:02 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 16:18:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fc8bff-9161-4a75-81b1-bdb957ef8b2d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:18:02 user nova-compute[74646]: No targets found.
Oct 26 16:18:02 user nova-compute[74646]: iSNS:
Oct 26 16:18:02 user nova-compute[74646]: No targets found.
Oct 26 16:18:02 user nova-compute[74646]: STATIC:
Oct 26 16:18:02 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89
Oct 26 16:18:02 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:18:02 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:18:02 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6
Oct 26 16:18:02 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:18:02 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:18:02 user nova-compute[74646]: FIRMWARE:
Oct 26 16:18:02 user nova-compute[74646]: No targets found.
Oct 26 16:18:02 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:18:02 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:18:02 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f02a46-9727-4bb7-b300-003d335fd275]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[5146a773-b08e-41b7-8488-6a9b3d55674d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:18:02 user nova-compute[74646]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)
Oct 26 16:18:02 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:18:02 user nova-compute[74646]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)
Oct 26 16:18:02 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d044d360>, {}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Disconnecting from: [] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] <== disconnect_volume: return (74ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:18:02 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:18:03 user nova-compute[74646]: DEBUG nova.compute.manager [req-200d4f59-c4f8-4d2b-9813-9248c511f135 req-eef8f8a4-d17d-4a01-b5d6-90853dba9f01 service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-200d4f59-c4f8-4d2b-9813-9248c511f135 req-eef8f8a4-d17d-4a01-b5d6-90853dba9f01 service nova] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-200d4f59-c4f8-4d2b-9813-9248c511f135 req-eef8f8a4-d17d-4a01-b5d6-90853dba9f01 service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-200d4f59-c4f8-4d2b-9813-9248c511f135 req-eef8f8a4-d17d-4a01-b5d6-90853dba9f01 service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:03 user nova-compute[74646]: DEBUG nova.compute.manager [req-200d4f59-c4f8-4d2b-9813-9248c511f135 req-eef8f8a4-d17d-4a01-b5d6-90853dba9f01 service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] No waiting events found dispatching network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:18:03 user nova-compute[74646]: WARNING nova.compute.manager [req-200d4f59-c4f8-4d2b-9813-9248c511f135 req-eef8f8a4-d17d-4a01-b5d6-90853dba9f01 service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received unexpected event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e for instance with vm_state active and task_state rebuilding.
Oct 26 16:18:04 user nova-compute[74646]: DEBUG nova.compute.manager [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Preparing to wait for external event volume-reimaged-9a126a47-5333-4520-aac0-f6982c44715c {{(pid=74646) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 26 16:18:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:04 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "379252a5-ba76-4593-b792-ae426aa52104" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "379252a5-ba76-4593-b792-ae426aa52104" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG nova.compute.manager [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:18:13 user nova-compute[74646]: INFO nova.compute.claims [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Claim successful on node user
Oct 26 16:18:13 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.335s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG nova.compute.manager [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG nova.compute.manager [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG nova.network.neutron [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:18:13 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:18:13 user nova-compute[74646]: DEBUG nova.compute.manager [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG nova.policy [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41c8a2a8c5594cca9451ab93e681dcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b251085ed49c991eef6c2df0b0990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG nova.compute.manager [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:18:13 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Creating image(s)
Oct 26 16:18:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "/opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "/opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "/opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.199s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.191s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk 1073741824" returned: 0 in 0.065s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.263s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG nova.network.neutron [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Successfully created port: 8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.211s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Cannot resize image /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Ensure instance console log exists: /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:14 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.network.neutron [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Successfully updated port: 8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "refresh_cache-379252a5-ba76-4593-b792-ae426aa52104" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquired lock "refresh_cache-379252a5-ba76-4593-b792-ae426aa52104" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.network.neutron [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-f00878eb-b685-4199-9c4c-17cd6ea2c40d req-be617122-8890-4486-a548-099b8358eaf5 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Received event network-changed-8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-f00878eb-b685-4199-9c4c-17cd6ea2c40d req-be617122-8890-4486-a548-099b8358eaf5 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Refreshing instance network info cache due to event network-changed-8001b20b-8c82-4b75-873f-8438e94014e8. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f00878eb-b685-4199-9c4c-17cd6ea2c40d req-be617122-8890-4486-a548-099b8358eaf5 service nova] Acquiring lock "refresh_cache-379252a5-ba76-4593-b792-ae426aa52104" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.network.neutron [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.network.neutron [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Updating instance_info_cache with network_info: [{"id": "8001b20b-8c82-4b75-873f-8438e94014e8", "address": "fa:16:3e:15:d2:8d", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8001b20b-8c", "ovs_interfaceid": "8001b20b-8c82-4b75-873f-8438e94014e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Releasing lock "refresh_cache-379252a5-ba76-4593-b792-ae426aa52104" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Instance network_info: |[{"id": "8001b20b-8c82-4b75-873f-8438e94014e8", "address": "fa:16:3e:15:d2:8d", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8001b20b-8c", "ovs_interfaceid": "8001b20b-8c82-4b75-873f-8438e94014e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f00878eb-b685-4199-9c4c-17cd6ea2c40d req-be617122-8890-4486-a548-099b8358eaf5 service nova] Acquired lock "refresh_cache-379252a5-ba76-4593-b792-ae426aa52104" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.network.neutron [req-f00878eb-b685-4199-9c4c-17cd6ea2c40d req-be617122-8890-4486-a548-099b8358eaf5 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Refreshing network info cache for port 8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Start _get_guest_xml network_info=[{"id": "8001b20b-8c82-4b75-873f-8438e94014e8", "address": "fa:16:3e:15:d2:8d", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8001b20b-8c", "ovs_interfaceid": "8001b20b-8c82-4b75-873f-8438e94014e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:18:15 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:18:15 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1578994054',display_name='tempest-AttachVolumeNegativeTest-server-1578994054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1578994054',id=43,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJebpDBcfVEYPK/q/sonF2GnzZNxHX2rXz6z6PuXRNsIG6MpVCEHXszGQRdW4w2SOPafGrpHxfoYjP84zJRSLyu7gEhSIzxpXn8quVFcpgSDSQboQd/pYIVQK5hXbWj4Q==',key_name='tempest-keypair-1017207549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f24b251085ed49c991eef6c2df0b0990',ramdisk_id='',reservation_id='r-2nns8n1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-340789388',owner_user_name='tempest-AttachVolumeNegativeTest-340789388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41c8a2a8c5594cca9451ab93e681dcd0',uuid=379252a5-ba76-4593-b792-ae426aa52104,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8001b20b-8c82-4b75-873f-8438e94014e8", "address": "fa:16:3e:15:d2:8d", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8001b20b-8c", "ovs_interfaceid": "8001b20b-8c82-4b75-873f-8438e94014e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converting VIF {"id": "8001b20b-8c82-4b75-873f-8438e94014e8", "address": "fa:16:3e:15:d2:8d", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8001b20b-8c", "ovs_interfaceid": "8001b20b-8c82-4b75-873f-8438e94014e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:d2:8d,bridge_name='br-int',has_traffic_filtering=True,id=8001b20b-8c82-4b75-873f-8438e94014e8,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8001b20b-8c') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.objects.instance [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lazy-loading 'pci_devices' on Instance uuid 379252a5-ba76-4593-b792-ae426aa52104 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:18:15 user nova-compute[74646]:   <uuid>379252a5-ba76-4593-b792-ae426aa52104</uuid>
Oct 26 16:18:15 user nova-compute[74646]:   <name>instance-0000002b</name>
Oct 26 16:18:15 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:18:15 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:18:15 user nova-compute[74646]:   <metadata>
Oct 26 16:18:15 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:18:15 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:18:15 user nova-compute[74646]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1578994054</nova:name>
Oct 26 16:18:15 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:18:15</nova:creationTime>
Oct 26 16:18:15 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:18:15 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:18:15 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:18:15 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:18:15 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:18:15 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:18:15 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:18:15 user nova-compute[74646]:       <nova:owner>
Oct 26 16:18:15 user nova-compute[74646]:         <nova:user uuid="41c8a2a8c5594cca9451ab93e681dcd0">tempest-AttachVolumeNegativeTest-340789388-project-member</nova:user>
Oct 26 16:18:15 user nova-compute[74646]:         <nova:project uuid="f24b251085ed49c991eef6c2df0b0990">tempest-AttachVolumeNegativeTest-340789388</nova:project>
Oct 26 16:18:15 user nova-compute[74646]:       </nova:owner>
Oct 26 16:18:15 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:18:15 user nova-compute[74646]:       <nova:ports>
Oct 26 16:18:15 user nova-compute[74646]:         <nova:port uuid="8001b20b-8c82-4b75-873f-8438e94014e8">
Oct 26 16:18:15 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 16:18:15 user nova-compute[74646]:         </nova:port>
Oct 26 16:18:15 user nova-compute[74646]:       </nova:ports>
Oct 26 16:18:15 user nova-compute[74646]:     </nova:instance>
Oct 26 16:18:15 user nova-compute[74646]:   </metadata>
Oct 26 16:18:15 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:18:15 user nova-compute[74646]:     <system>
Oct 26 16:18:15 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:18:15 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:18:15 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:18:15 user nova-compute[74646]:       <entry name="serial">379252a5-ba76-4593-b792-ae426aa52104</entry>
Oct 26 16:18:15 user nova-compute[74646]:       <entry name="uuid">379252a5-ba76-4593-b792-ae426aa52104</entry>
Oct 26 16:18:15 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:18:15 user nova-compute[74646]:     </system>
Oct 26 16:18:15 user nova-compute[74646]:   </sysinfo>
Oct 26 16:18:15 user nova-compute[74646]:   <os>
Oct 26 16:18:15 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:18:15 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:18:15 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:18:15 user nova-compute[74646]:   </os>
Oct 26 16:18:15 user nova-compute[74646]:   <features>
Oct 26 16:18:15 user nova-compute[74646]:     <acpi/>
Oct 26 16:18:15 user nova-compute[74646]:     <apic/>
Oct 26 16:18:15 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:18:15 user nova-compute[74646]:   </features>
Oct 26 16:18:15 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:18:15 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:18:15 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:18:15 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:18:15 user nova-compute[74646]:   </clock>
Oct 26 16:18:15 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:18:15 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:18:15 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:18:15 user nova-compute[74646]:   </cpu>
Oct 26 16:18:15 user nova-compute[74646]:   <devices>
Oct 26 16:18:15 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:18:15 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:18:15 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk"/>
Oct 26 16:18:15 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:18:15 user nova-compute[74646]:     </disk>
Oct 26 16:18:15 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:18:15 user nova-compute[74646]:       <mac address="fa:16:3e:15:d2:8d"/>
Oct 26 16:18:15 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:18:15 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:18:15 user nova-compute[74646]:       <target dev="tap8001b20b-8c"/>
Oct 26 16:18:15 user nova-compute[74646]:     </interface>
Oct 26 16:18:15 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:18:15 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/console.log" append="off"/>
Oct 26 16:18:15 user nova-compute[74646]:     </serial>
Oct 26 16:18:15 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:18:15 user nova-compute[74646]:     <video>
Oct 26 16:18:15 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:18:15 user nova-compute[74646]:     </video>
Oct 26 16:18:15 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:18:15 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:18:15 user nova-compute[74646]:     </rng>
Oct 26 16:18:15 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:18:15 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:18:15 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:18:15 user nova-compute[74646]:     </memballoon>
Oct 26 16:18:15 user nova-compute[74646]:   </devices>
Oct 26 16:18:15 user nova-compute[74646]: </domain>
Oct 26 16:18:15 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1578994054',display_name='tempest-AttachVolumeNegativeTest-server-1578994054',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1578994054',id=43,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJebpDBcfVEYPK/q/sonF2GnzZNxHX2rXz6z6PuXRNsIG6MpVCEHXszGQRdW4w2SOPafGrpHxfoYjP84zJRSLyu7gEhSIzxpXn8quVFcpgSDSQboQd/pYIVQK5hXbWj4Q==',key_name='tempest-keypair-1017207549',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f24b251085ed49c991eef6c2df0b0990',ramdisk_id='',reservation_id='r-2nns8n1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-340789388',owner_user_name='tempest-AttachVolumeNegativeTest-340789388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:18:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41c8a2a8c5594cca9451ab93e681dcd0',uuid=379252a5-ba76-4593-b792-ae426aa52104,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8001b20b-8c82-4b75-873f-8438e94014e8", "address": "fa:16:3e:15:d2:8d", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8001b20b-8c", "ovs_interfaceid": "8001b20b-8c82-4b75-873f-8438e94014e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converting VIF {"id": "8001b20b-8c82-4b75-873f-8438e94014e8", "address": "fa:16:3e:15:d2:8d", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8001b20b-8c", "ovs_interfaceid": "8001b20b-8c82-4b75-873f-8438e94014e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:d2:8d,bridge_name='br-int',has_traffic_filtering=True,id=8001b20b-8c82-4b75-873f-8438e94014e8,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8001b20b-8c') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG os_vif [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:d2:8d,bridge_name='br-int',has_traffic_filtering=True,id=8001b20b-8c82-4b75-873f-8438e94014e8,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8001b20b-8c') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '10a22976-1a24-5d72-a66c-fda20ffa4c57', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8001b20b-8c, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8001b20b-8c, col_values=(('qos', UUID('8507695a-613a-45b8-a87b-1c349f291387')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8001b20b-8c, col_values=(('external_ids', {'iface-id': '8001b20b-8c82-4b75-873f-8438e94014e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:d2:8d', 'vm-uuid': '379252a5-ba76-4593-b792-ae426aa52104'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:15 user nova-compute[74646]: INFO os_vif [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:d2:8d,bridge_name='br-int',has_traffic_filtering=True,id=8001b20b-8c82-4b75-873f-8438e94014e8,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8001b20b-8c')
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:18:15 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] No VIF found with MAC fa:16:3e:15:d2:8d, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:18:16 user nova-compute[74646]: DEBUG nova.network.neutron [req-f00878eb-b685-4199-9c4c-17cd6ea2c40d req-be617122-8890-4486-a548-099b8358eaf5 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Updated VIF entry in instance network info cache for port 8001b20b-8c82-4b75-873f-8438e94014e8. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:18:16 user nova-compute[74646]: DEBUG nova.network.neutron [req-f00878eb-b685-4199-9c4c-17cd6ea2c40d req-be617122-8890-4486-a548-099b8358eaf5 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Updating instance_info_cache with network_info: [{"id": "8001b20b-8c82-4b75-873f-8438e94014e8", "address": "fa:16:3e:15:d2:8d", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8001b20b-8c", "ovs_interfaceid": "8001b20b-8c82-4b75-873f-8438e94014e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:18:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f00878eb-b685-4199-9c4c-17cd6ea2c40d req-be617122-8890-4486-a548-099b8358eaf5 service nova] Releasing lock "refresh_cache-379252a5-ba76-4593-b792-ae426aa52104" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:18:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-540fa5b0-0815-4a67-9595-66a28f096989 req-f7003532-30d4-4bec-aeb6-32a96f2c73a7 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Received event network-vif-plugged-8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-540fa5b0-0815-4a67-9595-66a28f096989 req-f7003532-30d4-4bec-aeb6-32a96f2c73a7 service nova] Acquiring lock "379252a5-ba76-4593-b792-ae426aa52104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-540fa5b0-0815-4a67-9595-66a28f096989 req-f7003532-30d4-4bec-aeb6-32a96f2c73a7 service nova] Lock "379252a5-ba76-4593-b792-ae426aa52104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-540fa5b0-0815-4a67-9595-66a28f096989 req-f7003532-30d4-4bec-aeb6-32a96f2c73a7 service nova] Lock "379252a5-ba76-4593-b792-ae426aa52104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-540fa5b0-0815-4a67-9595-66a28f096989 req-f7003532-30d4-4bec-aeb6-32a96f2c73a7 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] No waiting events found dispatching network-vif-plugged-8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:18:17 user nova-compute[74646]: WARNING nova.compute.manager [req-540fa5b0-0815-4a67-9595-66a28f096989 req-f7003532-30d4-4bec-aeb6-32a96f2c73a7 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Received unexpected event network-vif-plugged-8001b20b-8c82-4b75-873f-8438e94014e8 for instance with vm_state building and task_state spawning.
Oct 26 16:18:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:18:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:18:19 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Instance spawned successfully.
Oct 26 16:18:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:18:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:18:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:18:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:18:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:18:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:18:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:18:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c1b5de1-c3ad-40a5-94dc-81f04c8b2c88 req-3dd65e7f-f816-4e9c-b84b-3de743387a56 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Received event network-vif-plugged-8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c1b5de1-c3ad-40a5-94dc-81f04c8b2c88 req-3dd65e7f-f816-4e9c-b84b-3de743387a56 service nova] Acquiring lock "379252a5-ba76-4593-b792-ae426aa52104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c1b5de1-c3ad-40a5-94dc-81f04c8b2c88 req-3dd65e7f-f816-4e9c-b84b-3de743387a56 service nova] Lock "379252a5-ba76-4593-b792-ae426aa52104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-6c1b5de1-c3ad-40a5-94dc-81f04c8b2c88 req-3dd65e7f-f816-4e9c-b84b-3de743387a56 service nova] Lock "379252a5-ba76-4593-b792-ae426aa52104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-6c1b5de1-c3ad-40a5-94dc-81f04c8b2c88 req-3dd65e7f-f816-4e9c-b84b-3de743387a56 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] No waiting events found dispatching network-vif-plugged-8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:18:19 user nova-compute[74646]: WARNING nova.compute.manager [req-6c1b5de1-c3ad-40a5-94dc-81f04c8b2c88 req-3dd65e7f-f816-4e9c-b84b-3de743387a56 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Received unexpected event network-vif-plugged-8001b20b-8c82-4b75-873f-8438e94014e8 for instance with vm_state building and task_state spawning.
Oct 26 16:18:19 user nova-compute[74646]: INFO nova.compute.manager [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Took 5.50 seconds to spawn the instance on the hypervisor.
Oct 26 16:18:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:18:19 user nova-compute[74646]: INFO nova.compute.manager [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Took 6.22 seconds to build instance.
Oct 26 16:18:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-27786caf-3924-4108-bae6-184424d49e11 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "379252a5-ba76-4593-b792-ae426aa52104" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.322s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:20 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:18:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:37 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:18:37 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:18:38 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:18:39 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:18:39 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:18:39 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Rebuilding the list of instances to heal {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 26 16:18:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:18:39 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:18:39 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1283575f-b614-42d5-b632-c1409f295207] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:18:39 user nova-compute[74646]: DEBUG nova.objects.instance [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lazy-loading 'info_cache' on Instance uuid 1283575f-b614-42d5-b632-c1409f295207 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:18:39 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1283575f-b614-42d5-b632-c1409f295207] Updating instance_info_cache with network_info: [{"id": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "address": "fa:16:3e:1b:cc:e1", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap366498f3-12", "ovs_interfaceid": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-1283575f-b614-42d5-b632-c1409f295207" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 1283575f-b614-42d5-b632-c1409f295207] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "1283575f-b614-42d5-b632-c1409f295207" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "1283575f-b614-42d5-b632-c1409f295207" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "1283575f-b614-42d5-b632-c1409f295207-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "1283575f-b614-42d5-b632-c1409f295207-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "1283575f-b614-42d5-b632-c1409f295207-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:40 user nova-compute[74646]: INFO nova.compute.manager [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Terminating instance
Oct 26 16:18:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-34535cac-2512-4921-af07-17beec06d701 req-68510d3a-d984-4c46-9a92-5d4112c0e52a service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received event network-vif-unplugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-34535cac-2512-4921-af07-17beec06d701 req-68510d3a-d984-4c46-9a92-5d4112c0e52a service nova] Acquiring lock "1283575f-b614-42d5-b632-c1409f295207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-34535cac-2512-4921-af07-17beec06d701 req-68510d3a-d984-4c46-9a92-5d4112c0e52a service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-34535cac-2512-4921-af07-17beec06d701 req-68510d3a-d984-4c46-9a92-5d4112c0e52a service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-34535cac-2512-4921-af07-17beec06d701 req-68510d3a-d984-4c46-9a92-5d4112c0e52a service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] No waiting events found dispatching network-vif-unplugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG nova.compute.manager [req-34535cac-2512-4921-af07-17beec06d701 req-68510d3a-d984-4c46-9a92-5d4112c0e52a service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received event network-vif-unplugged-366498f3-1228-49b7-b1cb-7c9c3b59423d for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG nova.compute.manager [req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 req-28d43b34-8e61-449a-945d-3fab7616f5d0 service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event volume-reimaged-9a126a47-5333-4520-aac0-f6982c44715c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 req-28d43b34-8e61-449a-945d-3fab7616f5d0 service nova] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 req-28d43b34-8e61-449a-945d-3fab7616f5d0 service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 req-28d43b34-8e61-449a-945d-3fab7616f5d0 service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG nova.compute.manager [req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 req-28d43b34-8e61-449a-945d-3fab7616f5d0 service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Processing event volume-reimaged-9a126a47-5333-4520-aac0-f6982c44715c {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG nova.compute.manager [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Instance event wait completed in 36 seconds for volume-reimaged {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:41 user nova-compute[74646]: INFO nova.virt.block_device [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Booting with volume 9a126a47-5333-4520-aac0-f6982c44715c at /dev/vda
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:41 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 1283575f-b614-42d5-b632-c1409f295207] Instance destroyed successfully.
Oct 26 16:18:41 user nova-compute[74646]: DEBUG nova.objects.instance [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lazy-loading 'resources' on Instance uuid 1283575f-b614-42d5-b632-c1409f295207 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T15:58:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-144059444',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-144059444',id=21,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T15:58:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='90e848952345455183c15fee816b6f12',ramdisk_id='',reservation_id='r-t1o4giqg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-580785668',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:00:08Z,user_data=None,user_id='abd7a869c235467ca4da99867c6bc0d4',uuid=1283575f-b614-42d5-b632-c1409f295207,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "address": "fa:16:3e:1b:cc:e1", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap366498f3-12", "ovs_interfaceid": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converting VIF {"id": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "address": "fa:16:3e:1b:cc:e1", "network": {"id": "53d9daa4-8d52-43cf-936f-69cb6b148895", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1091289211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "90e848952345455183c15fee816b6f12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap366498f3-12", "ovs_interfaceid": "366498f3-1228-49b7-b1cb-7c9c3b59423d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:cc:e1,bridge_name='br-int',has_traffic_filtering=True,id=366498f3-1228-49b7-b1cb-7c9c3b59423d,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap366498f3-12') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG os_vif [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:cc:e1,bridge_name='br-int',has_traffic_filtering=True,id=366498f3-1228-49b7-b1cb-7c9c3b59423d,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap366498f3-12') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap366498f3-12, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b8101557-fc6e-4774-9ff6-456c11307684) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:18:41 user nova-compute[74646]: INFO os_vif [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:cc:e1,bridge_name='br-int',has_traffic_filtering=True,id=366498f3-1228-49b7-b1cb-7c9c3b59423d,network=Network(53d9daa4-8d52-43cf-936f-69cb6b148895),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap366498f3-12')
Oct 26 16:18:41 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Deleting instance files /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207_del
Oct 26 16:18:41 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Deletion of /opt/stack/data/nova/instances/1283575f-b614-42d5-b632-c1409f295207_del complete
Oct 26 16:18:41 user nova-compute[74646]: DEBUG os_brick.utils [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[58051788-b2e1-4ed7-be1b-9c0fa27c2ad9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[42d2e5c7-d9f4-4958-9590-f4c9e1495d2b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:41 user nova-compute[74646]: INFO nova.compute.manager [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] [instance: 1283575f-b614-42d5-b632-c1409f295207] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 1283575f-b614-42d5-b632-c1409f295207] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 1283575f-b614-42d5-b632-c1409f295207] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc8f9ba-72ba-4538-9881-adae08e85e36]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd437aa-ba45-4588-8b20-cda8bdf0b876]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:18:41 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7240bfac-17f4-4f93-b417-88e13f03378a]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG os_brick.utils [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Updating existing volume attachment record: fc2b578f-1ea5-479f-81ab-de0ede1da365 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:41 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 1283575f-b614-42d5-b632-c1409f295207] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-cedf81f4-8aa5-40ac-bfe9-15e6f32e725d req-e916e5eb-1f50-44cc-801c-a2404cece2b0 service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received event network-vif-deleted-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:42 user nova-compute[74646]: INFO nova.compute.manager [req-cedf81f4-8aa5-40ac-bfe9-15e6f32e725d req-e916e5eb-1f50-44cc-801c-a2404cece2b0 service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Neutron deleted interface 366498f3-1228-49b7-b1cb-7c9c3b59423d; detaching it from the instance and deleting it from the info cache
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.network.neutron [req-cedf81f4-8aa5-40ac-bfe9-15e6f32e725d req-e916e5eb-1f50-44cc-801c-a2404cece2b0 service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:18:42 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 1283575f-b614-42d5-b632-c1409f295207] Took 0.68 seconds to deallocate network for instance.
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-cedf81f4-8aa5-40ac-bfe9-15e6f32e725d req-e916e5eb-1f50-44cc-801c-a2404cece2b0 service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Detach interface failed, port_id=366498f3-1228-49b7-b1cb-7c9c3b59423d, reason: Instance 1283575f-b614-42d5-b632-c1409f295207 could not be found. {{(pid=74646) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:42 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:18:42 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8529MB free_disk=25.306591033935547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received event network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Acquiring lock "1283575f-b614-42d5-b632-c1409f295207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] No waiting events found dispatching network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:18:42 user nova-compute[74646]: WARNING nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received unexpected event network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d for instance with vm_state deleted and task_state None.
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received event network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Acquiring lock "1283575f-b614-42d5-b632-c1409f295207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] No waiting events found dispatching network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:18:42 user nova-compute[74646]: WARNING nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received unexpected event network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d for instance with vm_state deleted and task_state None.
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received event network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Acquiring lock "1283575f-b614-42d5-b632-c1409f295207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] No waiting events found dispatching network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:18:42 user nova-compute[74646]: WARNING nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received unexpected event network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d for instance with vm_state deleted and task_state None.
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received event network-vif-unplugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Acquiring lock "1283575f-b614-42d5-b632-c1409f295207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] No waiting events found dispatching network-vif-unplugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:18:42 user nova-compute[74646]: WARNING nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received unexpected event network-vif-unplugged-366498f3-1228-49b7-b1cb-7c9c3b59423d for instance with vm_state deleted and task_state None.
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received event network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Acquiring lock "1283575f-b614-42d5-b632-c1409f295207-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] Lock "1283575f-b614-42d5-b632-c1409f295207-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] No waiting events found dispatching network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:18:42 user nova-compute[74646]: WARNING nova.compute.manager [req-b4ed67f4-67c2-4610-a2fc-89596459d588 req-77955bae-664c-4cbb-ab15-6c0febef099e service nova] [instance: 1283575f-b614-42d5-b632-c1409f295207] Received unexpected event network-vif-plugged-366498f3-1228-49b7-b1cb-7c9c3b59423d for instance with vm_state deleted and task_state None.
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.743s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.237s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:42 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Deleted allocations for instance 1283575f-b614-42d5-b632-c1409f295207
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance dd13d851-9338-4811-b48f-06c719844358 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance ed415bf2-5b3a-4b37-b069-7d206f0d6700 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 4ad85ba6-d405-4bdb-b982-0ebf75ccb107 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 379252a5-ba76-4593-b792-ae426aa52104 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:18:42 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:18:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-8d725b28-0578-4c54-8130-a39af1064754 tempest-ServerBootFromVolumeStableRescueTest-580785668 tempest-ServerBootFromVolumeStableRescueTest-580785668-project-member] Lock "1283575f-b614-42d5-b632-c1409f295207" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.654s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:43 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:18:43 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:18:43 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:18:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.303s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:44 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:18:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:47 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:18:48 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:18:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:18:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:18:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 16:18:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:18:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:18:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-26483678-2198-464a-a58a-06fb5e94e068 req-a08c8d54-c2ed-4ffa-add2-00dd6581f8ff service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Received event network-changed-89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:56 user nova-compute[74646]: DEBUG nova.compute.manager [req-26483678-2198-464a-a58a-06fb5e94e068 req-a08c8d54-c2ed-4ffa-add2-00dd6581f8ff service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Refreshing instance network info cache due to event network-changed-89be41e6-27b0-4d07-9bb3-42ac2f79c7be. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:18:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-26483678-2198-464a-a58a-06fb5e94e068 req-a08c8d54-c2ed-4ffa-add2-00dd6581f8ff service nova] Acquiring lock "refresh_cache-4ad85ba6-d405-4bdb-b982-0ebf75ccb107" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:18:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-26483678-2198-464a-a58a-06fb5e94e068 req-a08c8d54-c2ed-4ffa-add2-00dd6581f8ff service nova] Acquired lock "refresh_cache-4ad85ba6-d405-4bdb-b982-0ebf75ccb107" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:18:56 user nova-compute[74646]: DEBUG nova.network.neutron [req-26483678-2198-464a-a58a-06fb5e94e068 req-a08c8d54-c2ed-4ffa-add2-00dd6581f8ff service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Refreshing network info cache for port 89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:18:57 user nova-compute[74646]: DEBUG nova.network.neutron [req-26483678-2198-464a-a58a-06fb5e94e068 req-a08c8d54-c2ed-4ffa-add2-00dd6581f8ff service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Updated VIF entry in instance network info cache for port 89be41e6-27b0-4d07-9bb3-42ac2f79c7be. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:18:57 user nova-compute[74646]: DEBUG nova.network.neutron [req-26483678-2198-464a-a58a-06fb5e94e068 req-a08c8d54-c2ed-4ffa-add2-00dd6581f8ff service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Updating instance_info_cache with network_info: [{"id": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "address": "fa:16:3e:1d:c4:ce", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89be41e6-27", "ovs_interfaceid": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:18:57 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-26483678-2198-464a-a58a-06fb5e94e068 req-a08c8d54-c2ed-4ffa-add2-00dd6581f8ff service nova] Releasing lock "refresh_cache-4ad85ba6-d405-4bdb-b982-0ebf75ccb107" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-ed7c8a9e-ccf1-4da0-a96a-6065284e8bdb req-5a6c6033-822f-4640-97fd-d3a4ce9bfacf service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Received event network-changed-89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-ed7c8a9e-ccf1-4da0-a96a-6065284e8bdb req-5a6c6033-822f-4640-97fd-d3a4ce9bfacf service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Refreshing instance network info cache due to event network-changed-89be41e6-27b0-4d07-9bb3-42ac2f79c7be. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ed7c8a9e-ccf1-4da0-a96a-6065284e8bdb req-5a6c6033-822f-4640-97fd-d3a4ce9bfacf service nova] Acquiring lock "refresh_cache-4ad85ba6-d405-4bdb-b982-0ebf75ccb107" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ed7c8a9e-ccf1-4da0-a96a-6065284e8bdb req-5a6c6033-822f-4640-97fd-d3a4ce9bfacf service nova] Acquired lock "refresh_cache-4ad85ba6-d405-4bdb-b982-0ebf75ccb107" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG nova.network.neutron [req-ed7c8a9e-ccf1-4da0-a96a-6065284e8bdb req-5a6c6033-822f-4640-97fd-d3a4ce9bfacf service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Refreshing network info cache for port 89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:58 user nova-compute[74646]: INFO nova.compute.manager [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Terminating instance
Oct 26 16:18:58 user nova-compute[74646]: DEBUG nova.compute.manager [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:58 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Instance destroyed successfully.
Oct 26 16:18:58 user nova-compute[74646]: DEBUG nova.objects.instance [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lazy-loading 'resources' on Instance uuid 4ad85ba6-d405-4bdb-b982-0ebf75ccb107 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:17:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1938256860',display_name='tempest-TestVolumeBootPattern-server-1938256860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1938256860',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcrhPEoRoaB0ki3RmOaZ3eTquho7+8b0QqO8Voy8+ev28RwRqncTnJ8yqJ/AeeNTkufE9hPbEWGpSzdo215+QWyfPE53vOWOtQaI8OQeut+svp088xcotWDN6W4cNUpMQ==',key_name='tempest-TestVolumeBootPattern-371467899',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:17:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-4c3jbjh1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:17:28Z,user_data=None,user_id='9419f9603ca647269ed1cf42e233507f',uuid=4ad85ba6-d405-4bdb-b982-0ebf75ccb107,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "address": "fa:16:3e:1d:c4:ce", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89be41e6-27", "ovs_interfaceid": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "address": "fa:16:3e:1d:c4:ce", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89be41e6-27", "ovs_interfaceid": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1d:c4:ce,bridge_name='br-int',has_traffic_filtering=True,id=89be41e6-27b0-4d07-9bb3-42ac2f79c7be,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89be41e6-27') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG os_vif [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:c4:ce,bridge_name='br-int',has_traffic_filtering=True,id=89be41e6-27b0-4d07-9bb3-42ac2f79c7be,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89be41e6-27') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89be41e6-27, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ff26febf-3ea5-422a-a397-2cb3a133a874) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:18:58 user nova-compute[74646]: INFO os_vif [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1d:c4:ce,bridge_name='br-int',has_traffic_filtering=True,id=89be41e6-27b0-4d07-9bb3-42ac2f79c7be,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89be41e6-27')
Oct 26 16:18:58 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ValHwUWS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:18:58 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:18:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6585fa7-9356-49f4-bd95-37333966513f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:18:58 user nova-compute[74646]: No targets found.
Oct 26 16:18:58 user nova-compute[74646]: iSNS:
Oct 26 16:18:58 user nova-compute[74646]: No targets found.
Oct 26 16:18:58 user nova-compute[74646]: STATIC:
Oct 26 16:18:58 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89
Oct 26 16:18:58 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:18:58 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:18:58 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6
Oct 26 16:18:58 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:18:58 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:18:58 user nova-compute[74646]: FIRMWARE:
Oct 26 16:18:58 user nova-compute[74646]: No targets found.
Oct 26 16:18:58 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:18:58 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:18:58 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-f3b8bfcc-6731-413d-8212-cff94669d6c4 req-27e8d304-0700-4d1d-9df3-d9b2ed752ef5 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Received event network-vif-unplugged-89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f3b8bfcc-6731-413d-8212-cff94669d6c4 req-27e8d304-0700-4d1d-9df3-d9b2ed752ef5 service nova] Acquiring lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f3b8bfcc-6731-413d-8212-cff94669d6c4 req-27e8d304-0700-4d1d-9df3-d9b2ed752ef5 service nova] Lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f3b8bfcc-6731-413d-8212-cff94669d6c4 req-27e8d304-0700-4d1d-9df3-d9b2ed752ef5 service nova] Lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-f3b8bfcc-6731-413d-8212-cff94669d6c4 req-27e8d304-0700-4d1d-9df3-d9b2ed752ef5 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] No waiting events found dispatching network-vif-unplugged-89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-f3b8bfcc-6731-413d-8212-cff94669d6c4 req-27e8d304-0700-4d1d-9df3-d9b2ed752ef5 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Received event network-vif-unplugged-89be41e6-27b0-4d07-9bb3-42ac2f79c7be for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-f3b8bfcc-6731-413d-8212-cff94669d6c4 req-27e8d304-0700-4d1d-9df3-d9b2ed752ef5 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Received event network-vif-plugged-89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f3b8bfcc-6731-413d-8212-cff94669d6c4 req-27e8d304-0700-4d1d-9df3-d9b2ed752ef5 service nova] Acquiring lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f3b8bfcc-6731-413d-8212-cff94669d6c4 req-27e8d304-0700-4d1d-9df3-d9b2ed752ef5 service nova] Lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-f3b8bfcc-6731-413d-8212-cff94669d6c4 req-27e8d304-0700-4d1d-9df3-d9b2ed752ef5 service nova] Lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG nova.compute.manager [req-f3b8bfcc-6731-413d-8212-cff94669d6c4 req-27e8d304-0700-4d1d-9df3-d9b2ed752ef5 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] No waiting events found dispatching network-vif-plugged-89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:18:58 user nova-compute[74646]: WARNING nova.compute.manager [req-f3b8bfcc-6731-413d-8212-cff94669d6c4 req-27e8d304-0700-4d1d-9df3-d9b2ed752ef5 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Received unexpected event network-vif-plugged-89be41e6-27b0-4d07-9bb3-42ac2f79c7be for instance with vm_state active and task_state deleting.
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c977ffec-86d5-41cf-a3f5-04e807fcc2f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f920c41-d620-4e0d-9570-7f641528722e]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:18:58 user nova-compute[74646]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)
Oct 26 16:18:58 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:18:58 user nova-compute[74646]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 (non-flash)
Oct 26 16:18:58 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e036ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6'): ({'sdd'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Removing single pathed devices sdd {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3909083b-c54e-4381-b713-59632e232b7a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:58 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee137ada-05f5-4b0f-ac02-f83870d3e5e6]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flushing IO for device /dev/sdd {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a368168e-ccec-4b73-aafa-c9f8b3530e9b]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG nova.network.neutron [req-ed7c8a9e-ccf1-4da0-a96a-6065284e8bdb req-5a6c6033-822f-4640-97fd-d3a4ce9bfacf service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Updated VIF entry in instance network info cache for port 89be41e6-27b0-4d07-9bb3-42ac2f79c7be. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG nova.network.neutron [req-ed7c8a9e-ccf1-4da0-a96a-6065284e8bdb req-5a6c6033-822f-4640-97fd-d3a4ce9bfacf service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Updating instance_info_cache with network_info: [{"id": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "address": "fa:16:3e:1d:c4:ce", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89be41e6-27", "ovs_interfaceid": "89be41e6-27b0-4d07-9bb3-42ac2f79c7be", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.047s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[54279864-0375-428d-a084-21b2769ce876]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] SCSI volumes sdd have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.260s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[79432e86-bff1-47e2-ae94-e3c81c63d496]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ed7c8a9e-ccf1-4da0-a96a-6065284e8bdb req-5a6c6033-822f-4640-97fd-d3a4ce9bfacf service nova] Releasing lock "refresh_cache-4ad85ba6-d405-4bdb-b982-0ebf75ccb107" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4be49544-02ff-4ac9-a216-62c43e2ec871]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6, portal: 172.16.0.220,3260]
Oct 26 16:18:59 user nova-compute[74646]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6, portal: 172.16.0.220,3260] successful.
Oct 26 16:18:59 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cf6809fa-dcdc-4421-b6d3-a604072b1ff6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[065fdbd9-0a7a-43d8-b35c-8718d8b3c9c7]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.584s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== disconnect_volume: return (586ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:18:59 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Deleting instance files /opt/stack/data/nova/instances/4ad85ba6-d405-4bdb-b982-0ebf75ccb107_del
Oct 26 16:18:59 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Deletion of /opt/stack/data/nova/instances/4ad85ba6-d405-4bdb-b982-0ebf75ccb107_del complete
Oct 26 16:18:59 user nova-compute[74646]: INFO nova.compute.manager [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Took 1.45 seconds to destroy the instance on the hypervisor.
Oct 26 16:18:59 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:18:59 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:19:00 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Took 0.50 seconds to deallocate network for instance.
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.compute.manager [req-a32832be-5ba1-457a-b49d-670a6907067a req-8ae7a87b-1a85-48e6-acf2-d53464d1d528 service nova] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Received event network-vif-deleted-89be41e6-27b0-4d07-9bb3-42ac2f79c7be {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:19:00 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Creating image(s)
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Did not create local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Ensure instance console log exists: /opt/stack/data/nova/instances/ed415bf2-5b3a-4b37-b069-7d206f0d6700/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Start _get_guest_xml network_info=[{"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'guest_format': None, 'boot_index': 0, 'mount_device': '/dev/vda', 'attachment_id': 'fc2b578f-1ea5-479f-81ab-de0ede1da365', 'device_type': 'disk', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSmuCPNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ed415bf2-5b3a-4b37-b069-7d206f0d6700', 'attached_at': '', 'detached_at': '', 'volume_id': '9a126a47-5333-4520-aac0-f6982c44715c', 'serial': '9a126a47-5333-4520-aac0-f6982c44715c'}, 'disk_bus': 'virtio', 'delete_on_termination': True, 'volume_type': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:19:00 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 16:19:00 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.objects.instance [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lazy-loading 'vcpu_model' on Instance uuid ed415bf2-5b3a-4b37-b069-7d206f0d6700 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSmuCPNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:19:00 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:19:00 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:19:00 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd634fb3-1a9b-4b42-ae16-ac33d6e5aeac]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:19:00 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42cb46b-61c4-4215-9efb-971c7b4a5b8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c] added
Oct 26 16:19:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28f3846-29e1-4668-837d-5ac76746f894]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3a366e-adf4-483f-92a5-a0b3a34a87c1]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iSmuCPNh {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iSmuCPNh" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4121db4-86c4-4f53-ab0e-2a3b7dbc81d8]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iSmuCPNh'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbafa3e1-2151-4fed-ace2-4607088c4b34]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce61090-207c-4391-9596-c20dabe6149c]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:19:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:19:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a5f924-f065-45c8-bc10-ea0e5af6894c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260]
Oct 26 16:19:00 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260] successful.
Oct 26 16:19:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d35968-b245-494a-9b07-b2fea1191737]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b36f17-10d1-4dcd-9b5c-8bb7b2384280]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:19:00 user nova-compute[74646]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:19:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:19:00 user nova-compute[74646]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:19:00 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a98534-f275-4c8c-bd0f-246a82a4f72f]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSmuCPNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:19:00 user nova-compute[74646]: INFO nova.compute.manager [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: 4ad85ba6-d405-4bdb-b982-0ebf75ccb107] Took 0.91 seconds to detach 1 volumes for instance.
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:19:00 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:19:01 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Deleted allocations for instance 4ad85ba6-d405-4bdb-b982-0ebf75ccb107
Oct 26 16:19:01 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-ee01d93d-f1fa-46c6-b059-ae56312fdcdb tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "4ad85ba6-d405-4bdb-b982-0ebf75ccb107" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.231s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26632353965383734', 'path': '/dev/sdb'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632353965383734', 'path': '/dev/sdb'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T16:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1909920837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-508729915',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0IqpbEUj9FTXwsltPcQQxE3mw3HOun3lOf6u+YSQ0CcyJV6/G/ONdi3SGnlhdvJqfyz0BhUnqVGVb/CKZrfcM/4Xw4szISMudN+QKZ31ox5/FMuTnBsO4uIsAc0O90zg==',key_name='tempest-keypair-341580469',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:16:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bffc92069c704c6fac59cda13fa72e52',ramdisk_id='',reservation_id='r-7wch87hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1491440656',owner_user_name='tempest-ServerActionsV293TestJSON-1491440656-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:18:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='726dd5eaa0cd45ada546ac68fe04ef40',uuid=ed415bf2-5b3a-4b37-b069-7d206f0d6700,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Converting VIF {"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:86,bridge_name='br-int',has_traffic_filtering=True,id=26d80c0f-407c-453c-94b9-8a19b9a0b11e,network=Network(e5675dc6-92c8-465e-a116-18c24d116464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26d80c0f-40') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:19:01 user nova-compute[74646]:   <uuid>ed415bf2-5b3a-4b37-b069-7d206f0d6700</uuid>
Oct 26 16:19:01 user nova-compute[74646]:   <name>instance-00000029</name>
Oct 26 16:19:01 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:19:01 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:19:01 user nova-compute[74646]:   <metadata>
Oct 26 16:19:01 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:19:01 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:19:01 user nova-compute[74646]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1909920837</nova:name>
Oct 26 16:19:01 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:19:00</nova:creationTime>
Oct 26 16:19:01 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:19:01 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:19:01 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:19:01 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:19:01 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:19:01 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:19:01 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:19:01 user nova-compute[74646]:       <nova:owner>
Oct 26 16:19:01 user nova-compute[74646]:         <nova:user uuid="726dd5eaa0cd45ada546ac68fe04ef40">tempest-ServerActionsV293TestJSON-1491440656-project-member</nova:user>
Oct 26 16:19:01 user nova-compute[74646]:         <nova:project uuid="bffc92069c704c6fac59cda13fa72e52">tempest-ServerActionsV293TestJSON-1491440656</nova:project>
Oct 26 16:19:01 user nova-compute[74646]:       </nova:owner>
Oct 26 16:19:01 user nova-compute[74646]:       <nova:ports>
Oct 26 16:19:01 user nova-compute[74646]:         <nova:port uuid="26d80c0f-407c-453c-94b9-8a19b9a0b11e">
Oct 26 16:19:01 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 16:19:01 user nova-compute[74646]:         </nova:port>
Oct 26 16:19:01 user nova-compute[74646]:       </nova:ports>
Oct 26 16:19:01 user nova-compute[74646]:     </nova:instance>
Oct 26 16:19:01 user nova-compute[74646]:   </metadata>
Oct 26 16:19:01 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:19:01 user nova-compute[74646]:     <system>
Oct 26 16:19:01 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:19:01 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:19:01 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:19:01 user nova-compute[74646]:       <entry name="serial">ed415bf2-5b3a-4b37-b069-7d206f0d6700</entry>
Oct 26 16:19:01 user nova-compute[74646]:       <entry name="uuid">ed415bf2-5b3a-4b37-b069-7d206f0d6700</entry>
Oct 26 16:19:01 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:19:01 user nova-compute[74646]:     </system>
Oct 26 16:19:01 user nova-compute[74646]:   </sysinfo>
Oct 26 16:19:01 user nova-compute[74646]:   <os>
Oct 26 16:19:01 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:19:01 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:19:01 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:19:01 user nova-compute[74646]:   </os>
Oct 26 16:19:01 user nova-compute[74646]:   <features>
Oct 26 16:19:01 user nova-compute[74646]:     <acpi/>
Oct 26 16:19:01 user nova-compute[74646]:     <apic/>
Oct 26 16:19:01 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:19:01 user nova-compute[74646]:   </features>
Oct 26 16:19:01 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:19:01 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:19:01 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:19:01 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:19:01 user nova-compute[74646]:   </clock>
Oct 26 16:19:01 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:19:01 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:19:01 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:19:01 user nova-compute[74646]:   </cpu>
Oct 26 16:19:01 user nova-compute[74646]:   <devices>
Oct 26 16:19:01 user nova-compute[74646]:     <disk type="block" device="disk">
Oct 26 16:19:01 user nova-compute[74646]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:19:01 user nova-compute[74646]:       <source dev="/dev/sdb"/>
Oct 26 16:19:01 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:19:01 user nova-compute[74646]:       <serial>9a126a47-5333-4520-aac0-f6982c44715c</serial>
Oct 26 16:19:01 user nova-compute[74646]:     </disk>
Oct 26 16:19:01 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:19:01 user nova-compute[74646]:       <mac address="fa:16:3e:ae:3c:86"/>
Oct 26 16:19:01 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:19:01 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:19:01 user nova-compute[74646]:       <target dev="tap26d80c0f-40"/>
Oct 26 16:19:01 user nova-compute[74646]:     </interface>
Oct 26 16:19:01 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:19:01 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/ed415bf2-5b3a-4b37-b069-7d206f0d6700/console.log" append="off"/>
Oct 26 16:19:01 user nova-compute[74646]:     </serial>
Oct 26 16:19:01 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:19:01 user nova-compute[74646]:     <video>
Oct 26 16:19:01 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:19:01 user nova-compute[74646]:     </video>
Oct 26 16:19:01 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:19:01 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:19:01 user nova-compute[74646]:     </rng>
Oct 26 16:19:01 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:19:01 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:19:01 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:19:01 user nova-compute[74646]:     </memballoon>
Oct 26 16:19:01 user nova-compute[74646]:   </devices>
Oct 26 16:19:01 user nova-compute[74646]: </domain>
Oct 26 16:19:01 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T16:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1909920837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-508729915',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0IqpbEUj9FTXwsltPcQQxE3mw3HOun3lOf6u+YSQ0CcyJV6/G/ONdi3SGnlhdvJqfyz0BhUnqVGVb/CKZrfcM/4Xw4szISMudN+QKZ31ox5/FMuTnBsO4uIsAc0O90zg==',key_name='tempest-keypair-341580469',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:16:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='bffc92069c704c6fac59cda13fa72e52',ramdisk_id='',reservation_id='r-7wch87hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1491440656',owner_user_name='tempest-ServerActionsV293TestJSON-1491440656-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:18:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='726dd5eaa0cd45ada546ac68fe04ef40',uuid=ed415bf2-5b3a-4b37-b069-7d206f0d6700,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Converting VIF {"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:86,bridge_name='br-int',has_traffic_filtering=True,id=26d80c0f-407c-453c-94b9-8a19b9a0b11e,network=Network(e5675dc6-92c8-465e-a116-18c24d116464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26d80c0f-40') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG os_vif [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:86,bridge_name='br-int',has_traffic_filtering=True,id=26d80c0f-407c-453c-94b9-8a19b9a0b11e,network=Network(e5675dc6-92c8-465e-a116-18c24d116464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26d80c0f-40') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9f3c9ce-b42d-5eb0-ab3b-8d75922ccaa2', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26d80c0f-40, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26d80c0f-40, col_values=(('qos', UUID('2050d8b8-1352-484e-a856-d6051b9ebb18')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26d80c0f-40, col_values=(('external_ids', {'iface-id': '26d80c0f-407c-453c-94b9-8a19b9a0b11e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:3c:86', 'vm-uuid': 'ed415bf2-5b3a-4b37-b069-7d206f0d6700'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:01 user nova-compute[74646]: INFO os_vif [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:86,bridge_name='br-int',has_traffic_filtering=True,id=26d80c0f-407c-453c-94b9-8a19b9a0b11e,network=Network(e5675dc6-92c8-465e-a116-18c24d116464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26d80c0f-40')
Oct 26 16:19:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:19:01 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] No VIF found with MAC fa:16:3e:ae:3c:86, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:19:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:03 user nova-compute[74646]: DEBUG nova.compute.manager [req-5815d446-0fc5-4a46-8462-b03471aeb719 req-504cbbcb-b0e4-4eae-9424-4522a0550246 service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:19:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5815d446-0fc5-4a46-8462-b03471aeb719 req-504cbbcb-b0e4-4eae-9424-4522a0550246 service nova] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:19:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5815d446-0fc5-4a46-8462-b03471aeb719 req-504cbbcb-b0e4-4eae-9424-4522a0550246 service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:19:03 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5815d446-0fc5-4a46-8462-b03471aeb719 req-504cbbcb-b0e4-4eae-9424-4522a0550246 service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:19:03 user nova-compute[74646]: DEBUG nova.compute.manager [req-5815d446-0fc5-4a46-8462-b03471aeb719 req-504cbbcb-b0e4-4eae-9424-4522a0550246 service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] No waiting events found dispatching network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:19:03 user nova-compute[74646]: WARNING nova.compute.manager [req-5815d446-0fc5-4a46-8462-b03471aeb719 req-504cbbcb-b0e4-4eae-9424-4522a0550246 service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received unexpected event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e for instance with vm_state active and task_state rebuild_spawning.
Oct 26 16:19:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG nova.compute.manager [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:19:05 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Instance spawned successfully.
Oct 26 16:19:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG nova.compute.manager [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-ae271c3e-29dc-493e-9901-13da2e37eaf1 req-0df85899-c380-4934-9c24-a5cab8f2daaa service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ae271c3e-29dc-493e-9901-13da2e37eaf1 req-0df85899-c380-4934-9c24-a5cab8f2daaa service nova] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ae271c3e-29dc-493e-9901-13da2e37eaf1 req-0df85899-c380-4934-9c24-a5cab8f2daaa service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-ae271c3e-29dc-493e-9901-13da2e37eaf1 req-0df85899-c380-4934-9c24-a5cab8f2daaa service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-ae271c3e-29dc-493e-9901-13da2e37eaf1 req-0df85899-c380-4934-9c24-a5cab8f2daaa service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] No waiting events found dispatching network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:19:05 user nova-compute[74646]: WARNING nova.compute.manager [req-ae271c3e-29dc-493e-9901-13da2e37eaf1 req-0df85899-c380-4934-9c24-a5cab8f2daaa service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received unexpected event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e for instance with vm_state active and task_state rebuild_spawning.
Oct 26 16:19:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG nova.objects.instance [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74646) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 26 16:19:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-594ae4fc-5aa2-4ef7-a0b3-d5c35688bc73 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.074s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:19:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:31 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:33 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:34 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:19:34 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Cleaning up deleted instances {{(pid=74646) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 26 16:19:34 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] There are 0 instances to clean {{(pid=74646) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 26 16:19:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:37 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:19:37 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Cleaning up deleted instances with incomplete migration  {{(pid=74646) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 26 16:19:38 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:19:38 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:19:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:19:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:19:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:19:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:19:40 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: dd13d851-9338-4811-b48f-06c719844358] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:19:41 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: dd13d851-9338-4811-b48f-06c719844358] Updating instance_info_cache with network_info: [{"id": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "address": "fa:16:3e:1b:eb:e2", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d137ce-6a", "ovs_interfaceid": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:19:41 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:19:41 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: dd13d851-9338-4811-b48f-06c719844358] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:19:41 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:19:41 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:19:41 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:19:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:43 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:19:43 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:19:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:19:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:19:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:19:43 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:19:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:19:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:19:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:19:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:19:43 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:19:43 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74646) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 26 16:19:44 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:19:44 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:19:44 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8596MB free_disk=25.301788330078125GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance dd13d851-9338-4811-b48f-06c719844358 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance ed415bf2-5b3a-4b37-b069-7d206f0d6700 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 379252a5-ba76-4593-b792-ae426aa52104 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing inventories for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Updating ProviderTree inventory for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Updating inventory in ProviderTree for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing aggregate associations for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6, aggregates: None {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Refreshing trait associations for resource provider 88f94598-b16e-4979-b37d-cf11430ad3e6, traits: COMPUTE_IMAGE_TYPE_ARI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSSE3,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_E1000,HW_CPU_X86_SSE41,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_SSE42,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=74646) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:19:44 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:19:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:48 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:19:49 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:19:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:19:57 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:20:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:20:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-8972a7ed-6940-409c-8005-89f0bdb18f13 req-32359df1-feca-41d7-bbfc-4b91045d9034 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Received event network-changed-8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:05 user nova-compute[74646]: DEBUG nova.compute.manager [req-8972a7ed-6940-409c-8005-89f0bdb18f13 req-32359df1-feca-41d7-bbfc-4b91045d9034 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Refreshing instance network info cache due to event network-changed-8001b20b-8c82-4b75-873f-8438e94014e8. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:20:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8972a7ed-6940-409c-8005-89f0bdb18f13 req-32359df1-feca-41d7-bbfc-4b91045d9034 service nova] Acquiring lock "refresh_cache-379252a5-ba76-4593-b792-ae426aa52104" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:20:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8972a7ed-6940-409c-8005-89f0bdb18f13 req-32359df1-feca-41d7-bbfc-4b91045d9034 service nova] Acquired lock "refresh_cache-379252a5-ba76-4593-b792-ae426aa52104" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:20:05 user nova-compute[74646]: DEBUG nova.network.neutron [req-8972a7ed-6940-409c-8005-89f0bdb18f13 req-32359df1-feca-41d7-bbfc-4b91045d9034 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Refreshing network info cache for port 8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:20:05 user nova-compute[74646]: DEBUG nova.network.neutron [req-8972a7ed-6940-409c-8005-89f0bdb18f13 req-32359df1-feca-41d7-bbfc-4b91045d9034 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Updated VIF entry in instance network info cache for port 8001b20b-8c82-4b75-873f-8438e94014e8. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:20:05 user nova-compute[74646]: DEBUG nova.network.neutron [req-8972a7ed-6940-409c-8005-89f0bdb18f13 req-32359df1-feca-41d7-bbfc-4b91045d9034 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Updating instance_info_cache with network_info: [{"id": "8001b20b-8c82-4b75-873f-8438e94014e8", "address": "fa:16:3e:15:d2:8d", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8001b20b-8c", "ovs_interfaceid": "8001b20b-8c82-4b75-873f-8438e94014e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:20:05 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8972a7ed-6940-409c-8005-89f0bdb18f13 req-32359df1-feca-41d7-bbfc-4b91045d9034 service nova] Releasing lock "refresh_cache-379252a5-ba76-4593-b792-ae426aa52104" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:20:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:06 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:10 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "379252a5-ba76-4593-b792-ae426aa52104" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "379252a5-ba76-4593-b792-ae426aa52104" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG nova.objects.instance [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lazy-loading 'flavor' on Instance uuid 379252a5-ba76-4593-b792-ae426aa52104 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "379252a5-ba76-4593-b792-ae426aa52104" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.108s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "379252a5-ba76-4593-b792-ae426aa52104" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "379252a5-ba76-4593-b792-ae426aa52104" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:12 user nova-compute[74646]: INFO nova.compute.manager [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Attaching volume 798b66f7-48d9-427f-ba1b-311a3430ab0f to /dev/vdb
Oct 26 16:20:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-3c4187c6-815b-4355-82ba-dd17eecd912a req-31cedf50-5666-4224-8a99-0336609d597d service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Received event network-changed-a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG nova.compute.manager [req-3c4187c6-815b-4355-82ba-dd17eecd912a req-31cedf50-5666-4224-8a99-0336609d597d service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Refreshing instance network info cache due to event network-changed-a3d137ce-6a6c-4f92-98fd-c4752d199e3c. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3c4187c6-815b-4355-82ba-dd17eecd912a req-31cedf50-5666-4224-8a99-0336609d597d service nova] Acquiring lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3c4187c6-815b-4355-82ba-dd17eecd912a req-31cedf50-5666-4224-8a99-0336609d597d service nova] Acquired lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-3c4187c6-815b-4355-82ba-dd17eecd912a req-31cedf50-5666-4224-8a99-0336609d597d service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Refreshing network info cache for port a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG os_brick.utils [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[47c72130-c7f5-4a39-a202-ddafa35ad507]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:907a3933e063\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb44817-d5ca-4e97-b2d4-1d7dd89becd5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f04c66-cd49-4d28-a9cb-174ab3f77aef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fdfa7e-42de-4439-a373-71ab842b35d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): nvme version {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] 'nvme version' failed. Not Retrying. {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] nvme not present on system {{(pid=74646) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 26 16:20:12 user nova-compute[74646]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2d8352-01b2-4018-be69-6a4bf39c63d9]: (4, '') {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74646) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.lightos [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] LIGHTOS: no hostnqn found. {{(pid=74646) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG os_brick.utils [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:907a3933e063', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG nova.virt.block_device [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Updating existing volume attachment record: a9ad8923-4b19-4e50-ad55-4a02cca1c4d9 {{(pid=74646) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "dd13d851-9338-4811-b48f-06c719844358" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "dd13d851-9338-4811-b48f-06c719844358" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "dd13d851-9338-4811-b48f-06c719844358-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "dd13d851-9338-4811-b48f-06c719844358-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "dd13d851-9338-4811-b48f-06c719844358-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:12 user nova-compute[74646]: INFO nova.compute.manager [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Terminating instance
Oct 26 16:20:12 user nova-compute[74646]: DEBUG nova.compute.manager [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-3c4187c6-815b-4355-82ba-dd17eecd912a req-31cedf50-5666-4224-8a99-0336609d597d service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Updated VIF entry in instance network info cache for port a3d137ce-6a6c-4f92-98fd-c4752d199e3c. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG nova.network.neutron [req-3c4187c6-815b-4355-82ba-dd17eecd912a req-31cedf50-5666-4224-8a99-0336609d597d service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Updating instance_info_cache with network_info: [{"id": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "address": "fa:16:3e:1b:eb:e2", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d137ce-6a", "ovs_interfaceid": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:20:12 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-3c4187c6-815b-4355-82ba-dd17eecd912a req-31cedf50-5666-4224-8a99-0336609d597d service nova] Releasing lock "refresh_cache-dd13d851-9338-4811-b48f-06c719844358" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG nova.compute.manager [req-fa1c8654-8f4c-41e8-8f93-3774051377d5 req-25e5e20a-0f8a-4370-8a0b-4c3acb62fb68 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Received event network-vif-unplugged-a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fa1c8654-8f4c-41e8-8f93-3774051377d5 req-25e5e20a-0f8a-4370-8a0b-4c3acb62fb68 service nova] Acquiring lock "dd13d851-9338-4811-b48f-06c719844358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fa1c8654-8f4c-41e8-8f93-3774051377d5 req-25e5e20a-0f8a-4370-8a0b-4c3acb62fb68 service nova] Lock "dd13d851-9338-4811-b48f-06c719844358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fa1c8654-8f4c-41e8-8f93-3774051377d5 req-25e5e20a-0f8a-4370-8a0b-4c3acb62fb68 service nova] Lock "dd13d851-9338-4811-b48f-06c719844358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG nova.compute.manager [req-fa1c8654-8f4c-41e8-8f93-3774051377d5 req-25e5e20a-0f8a-4370-8a0b-4c3acb62fb68 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] No waiting events found dispatching network-vif-unplugged-a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG nova.compute.manager [req-fa1c8654-8f4c-41e8-8f93-3774051377d5 req-25e5e20a-0f8a-4370-8a0b-4c3acb62fb68 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Received event network-vif-unplugged-a3d137ce-6a6c-4f92-98fd-c4752d199e3c for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:13 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: dd13d851-9338-4811-b48f-06c719844358] Instance destroyed successfully.
Oct 26 16:20:13 user nova-compute[74646]: DEBUG nova.objects.instance [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lazy-loading 'resources' on Instance uuid dd13d851-9338-4811-b48f-06c719844358 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:14:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-123124849',display_name='tempest-TestVolumeBootPattern-server-123124849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-123124849',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOcrhPEoRoaB0ki3RmOaZ3eTquho7+8b0QqO8Voy8+ev28RwRqncTnJ8yqJ/AeeNTkufE9hPbEWGpSzdo215+QWyfPE53vOWOtQaI8OQeut+svp088xcotWDN6W4cNUpMQ==',key_name='tempest-TestVolumeBootPattern-371467899',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:15:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a984c8da90ff476191cd5aa5787032c1',ramdisk_id='',reservation_id='r-4j0qkpar',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1231840017',owner_user_name='tempest-TestVolumeBootPattern-1231840017-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:15:12Z,user_data=None,user_id='9419f9603ca647269ed1cf42e233507f',uuid=dd13d851-9338-4811-b48f-06c719844358,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "address": "fa:16:3e:1b:eb:e2", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d137ce-6a", "ovs_interfaceid": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converting VIF {"id": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "address": "fa:16:3e:1b:eb:e2", "network": {"id": "7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1144545284-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a984c8da90ff476191cd5aa5787032c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3d137ce-6a", "ovs_interfaceid": "a3d137ce-6a6c-4f92-98fd-c4752d199e3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=a3d137ce-6a6c-4f92-98fd-c4752d199e3c,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3d137ce-6a') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_vif [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=a3d137ce-6a6c-4f92-98fd-c4752d199e3c,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3d137ce-6a') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3d137ce-6a, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fe2c16e3-df77-46ef-b8b0-50b2b43f3641) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:13 user nova-compute[74646]: INFO os_vif [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:eb:e2,bridge_name='br-int',has_traffic_filtering=True,id=a3d137ce-6a6c-4f92-98fd-c4752d199e3c,network=Network(7a7ed5a7-9ff5-480b-8ef0-0675ecd12fdd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3d137ce-6a')
Oct 26 16:20:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ocESsuLr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:20:13 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[51819f02-447a-4550-8d74-b1c828230791]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:20:13 user nova-compute[74646]: No targets found.
Oct 26 16:20:13 user nova-compute[74646]: iSNS:
Oct 26 16:20:13 user nova-compute[74646]: No targets found.
Oct 26 16:20:13 user nova-compute[74646]: STATIC:
Oct 26 16:20:13 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89
Oct 26 16:20:13 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:20:13 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:20:13 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c
Oct 26 16:20:13 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:20:13 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:20:13 user nova-compute[74646]: FIRMWARE:
Oct 26 16:20:13 user nova-compute[74646]: No targets found.
Oct 26 16:20:13 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:20:13 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:20:13 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[73728b7c-3a3e-4dae-ac20-2166b2c095a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[065ebe5b-bcc4-474b-b420-a679a8225c96]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:20:13 user nova-compute[74646]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:20:13 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 (non-flash)
Oct 26 16:20:13 user nova-compute[74646]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:20:13 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9e0182a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89'): ({'sdc'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Removing single pathed devices sdc {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e35c93e-14ea-417c-90ad-304c38236c0c]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc02ba7-0769-4f60-b124-d9cc79d7b4b5]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Flushing IO for device /dev/sdc {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7b2001-ea08-47ba-b07d-2be6656d9d37]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfeebfc7-7a5a-4a37-a8dd-99ecc56b1538]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23261366663323962', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_32f26705', '/dev/disk/by-id/scsi-1SCST_BIO32f26705-2a6fc29b88553a2a') {{(pid=85624) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f18ed08-110c-41a9-8fdc-3dc82ba91b0f]: (4, None) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0441c5-2b47-433c-9f87-110c805bbbac]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ab53279-01a7-468b-8f59-ff21052bed4f]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260]
Oct 26 16:20:13 user nova-compute[74646]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89, portal: 172.16.0.220,3260] successful.
Oct 26 16:20:13 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f37b06a8-2fb2-47e1-b42b-9223a5f9dd89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d2d4ed-e98c-49d7-9bcc-976e3a7e5087]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] <== disconnect_volume: return (309ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:20:13 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Deleting instance files /opt/stack/data/nova/instances/dd13d851-9338-4811-b48f-06c719844358_del
Oct 26 16:20:13 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Deletion of /opt/stack/data/nova/instances/dd13d851-9338-4811-b48f-06c719844358_del complete
Oct 26 16:20:13 user nova-compute[74646]: INFO nova.compute.manager [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 26 16:20:13 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: dd13d851-9338-4811-b48f-06c719844358] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:20:13 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: dd13d851-9338-4811-b48f-06c719844358] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:20:14 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: dd13d851-9338-4811-b48f-06c719844358] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:20:14 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: dd13d851-9338-4811-b48f-06c719844358] Took 0.88 seconds to deallocate network for instance.
Oct 26 16:20:14 user nova-compute[74646]: DEBUG nova.compute.manager [req-69bac32d-f949-4176-877b-a5aba1aa759a req-0c1356b8-6a9d-4280-b1a7-61d1ee083a89 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Received event network-vif-deleted-a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Acquiring lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-08601637-138b-4d0e-8f09-a3e1ad40cce7 req-9ce1d007-8d79-44e6-86e9-ac6e15de1615 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Received event network-vif-plugged-a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-08601637-138b-4d0e-8f09-a3e1ad40cce7 req-9ce1d007-8d79-44e6-86e9-ac6e15de1615 service nova] Acquiring lock "dd13d851-9338-4811-b48f-06c719844358-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-08601637-138b-4d0e-8f09-a3e1ad40cce7 req-9ce1d007-8d79-44e6-86e9-ac6e15de1615 service nova] Lock "dd13d851-9338-4811-b48f-06c719844358-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-08601637-138b-4d0e-8f09-a3e1ad40cce7 req-9ce1d007-8d79-44e6-86e9-ac6e15de1615 service nova] Lock "dd13d851-9338-4811-b48f-06c719844358-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG nova.compute.manager [req-08601637-138b-4d0e-8f09-a3e1ad40cce7 req-9ce1d007-8d79-44e6-86e9-ac6e15de1615 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] No waiting events found dispatching network-vif-plugged-a3d137ce-6a6c-4f92-98fd-c4752d199e3c {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:20:15 user nova-compute[74646]: WARNING nova.compute.manager [req-08601637-138b-4d0e-8f09-a3e1ad40cce7 req-9ce1d007-8d79-44e6-86e9-ac6e15de1615 service nova] [instance: dd13d851-9338-4811-b48f-06c719844358] Received unexpected event network-vif-plugged-a3d137ce-6a6c-4f92-98fd-c4752d199e3c for instance with vm_state active and task_state deleting.
Oct 26 16:20:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:20:15 user nova-compute[74646]: INFO nova.compute.claims [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Claim successful on node user
Oct 26 16:20:15 user nova-compute[74646]: INFO nova.compute.manager [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] [instance: dd13d851-9338-4811-b48f-06c719844358] Took 0.88 seconds to detach 1 volumes for instance.
Oct 26 16:20:15 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.366s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.051s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:20:15 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:20:15 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG nova.policy [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f2e62ec681748589c721f9dde24d2ba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '59dd17f01a8043d78909861b4649cd76', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:20:15 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.545s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:20:16 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Creating image(s)
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Acquiring lock "/opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "/opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "/opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:16 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Deleted allocations for instance dd13d851-9338-4811-b48f-06c719844358
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-45eb6b57-0742-4b1d-99c3-0123d1564779 tempest-TestVolumeBootPattern-1231840017 tempest-TestVolumeBootPattern-1231840017-project-member] Lock "dd13d851-9338-4811-b48f-06c719844358" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.797s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Successfully created port: 950d60ad-a0b7-4766-8da6-358a1ff3970f {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.194s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.171s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk 1073741824" returned: 0 in 0.052s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.199s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Successfully updated port: 950d60ad-a0b7-4766-8da6-358a1ff3970f {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Acquiring lock "refresh_cache-c605a36d-d653-40d7-8fb1-cdcba29f3a19" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:20:16 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Acquired lock "refresh_cache-c605a36d-d653-40d7-8fb1-cdcba29f3a19" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-182c1ff2-de1b-43c8-b8dd-ca4fd1bb1319 req-4a3cbce1-859b-4924-be30-ec0ba42eb1b8 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Received event network-changed-950d60ad-a0b7-4766-8da6-358a1ff3970f {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.compute.manager [req-182c1ff2-de1b-43c8-b8dd-ca4fd1bb1319 req-4a3cbce1-859b-4924-be30-ec0ba42eb1b8 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Refreshing instance network info cache due to event network-changed-950d60ad-a0b7-4766-8da6-358a1ff3970f. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-182c1ff2-de1b-43c8-b8dd-ca4fd1bb1319 req-4a3cbce1-859b-4924-be30-ec0ba42eb1b8 service nova] Acquiring lock "refresh_cache-c605a36d-d653-40d7-8fb1-cdcba29f3a19" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Cannot resize image /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Ensure instance console log exists: /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.network.neutron [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Updating instance_info_cache with network_info: [{"id": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "address": "fa:16:3e:8e:f6:84", "network": {"id": "57cf5edc-e523-4732-afa0-02f452cc448a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601411552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59dd17f01a8043d78909861b4649cd76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950d60ad-a0", "ovs_interfaceid": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Releasing lock "refresh_cache-c605a36d-d653-40d7-8fb1-cdcba29f3a19" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Instance network_info: |[{"id": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "address": "fa:16:3e:8e:f6:84", "network": {"id": "57cf5edc-e523-4732-afa0-02f452cc448a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601411552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59dd17f01a8043d78909861b4649cd76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950d60ad-a0", "ovs_interfaceid": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-182c1ff2-de1b-43c8-b8dd-ca4fd1bb1319 req-4a3cbce1-859b-4924-be30-ec0ba42eb1b8 service nova] Acquired lock "refresh_cache-c605a36d-d653-40d7-8fb1-cdcba29f3a19" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.network.neutron [req-182c1ff2-de1b-43c8-b8dd-ca4fd1bb1319 req-4a3cbce1-859b-4924-be30-ec0ba42eb1b8 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Refreshing network info cache for port 950d60ad-a0b7-4766-8da6-358a1ff3970f {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Start _get_guest_xml network_info=[{"id": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "address": "fa:16:3e:8e:f6:84", "network": {"id": "57cf5edc-e523-4732-afa0-02f452cc448a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601411552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59dd17f01a8043d78909861b4649cd76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950d60ad-a0", "ovs_interfaceid": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:20:17 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:20:17 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-840508483',display_name='tempest-VolumesActionsTest-instance-840508483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-840508483',id=44,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59dd17f01a8043d78909861b4649cd76',ramdisk_id='',reservation_id='r-ut9id5ke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-684642585',owner_user_name='tempest-VolumesActionsTest-684642585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:20:16Z,user_data=None,user_id='2f2e62ec681748589c721f9dde24d2ba',uuid=c605a36d-d653-40d7-8fb1-cdcba29f3a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "address": "fa:16:3e:8e:f6:84", "network": {"id": "57cf5edc-e523-4732-afa0-02f452cc448a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601411552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59dd17f01a8043d78909861b4649cd76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950d60ad-a0", "ovs_interfaceid": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Converting VIF {"id": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "address": "fa:16:3e:8e:f6:84", "network": {"id": "57cf5edc-e523-4732-afa0-02f452cc448a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601411552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59dd17f01a8043d78909861b4649cd76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950d60ad-a0", "ovs_interfaceid": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f6:84,bridge_name='br-int',has_traffic_filtering=True,id=950d60ad-a0b7-4766-8da6-358a1ff3970f,network=Network(57cf5edc-e523-4732-afa0-02f452cc448a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950d60ad-a0') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.objects.instance [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lazy-loading 'pci_devices' on Instance uuid c605a36d-d653-40d7-8fb1-cdcba29f3a19 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:20:17 user nova-compute[74646]:   <uuid>c605a36d-d653-40d7-8fb1-cdcba29f3a19</uuid>
Oct 26 16:20:17 user nova-compute[74646]:   <name>instance-0000002c</name>
Oct 26 16:20:17 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:20:17 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:20:17 user nova-compute[74646]:   <metadata>
Oct 26 16:20:17 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:20:17 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:20:17 user nova-compute[74646]:       <nova:name>tempest-VolumesActionsTest-instance-840508483</nova:name>
Oct 26 16:20:17 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:20:17</nova:creationTime>
Oct 26 16:20:17 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:20:17 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:20:17 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:20:17 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:20:17 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:20:17 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:20:17 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:20:17 user nova-compute[74646]:       <nova:owner>
Oct 26 16:20:17 user nova-compute[74646]:         <nova:user uuid="2f2e62ec681748589c721f9dde24d2ba">tempest-VolumesActionsTest-684642585-project-member</nova:user>
Oct 26 16:20:17 user nova-compute[74646]:         <nova:project uuid="59dd17f01a8043d78909861b4649cd76">tempest-VolumesActionsTest-684642585</nova:project>
Oct 26 16:20:17 user nova-compute[74646]:       </nova:owner>
Oct 26 16:20:17 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:20:17 user nova-compute[74646]:       <nova:ports>
Oct 26 16:20:17 user nova-compute[74646]:         <nova:port uuid="950d60ad-a0b7-4766-8da6-358a1ff3970f">
Oct 26 16:20:17 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 26 16:20:17 user nova-compute[74646]:         </nova:port>
Oct 26 16:20:17 user nova-compute[74646]:       </nova:ports>
Oct 26 16:20:17 user nova-compute[74646]:     </nova:instance>
Oct 26 16:20:17 user nova-compute[74646]:   </metadata>
Oct 26 16:20:17 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:20:17 user nova-compute[74646]:     <system>
Oct 26 16:20:17 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:20:17 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:20:17 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:20:17 user nova-compute[74646]:       <entry name="serial">c605a36d-d653-40d7-8fb1-cdcba29f3a19</entry>
Oct 26 16:20:17 user nova-compute[74646]:       <entry name="uuid">c605a36d-d653-40d7-8fb1-cdcba29f3a19</entry>
Oct 26 16:20:17 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:20:17 user nova-compute[74646]:     </system>
Oct 26 16:20:17 user nova-compute[74646]:   </sysinfo>
Oct 26 16:20:17 user nova-compute[74646]:   <os>
Oct 26 16:20:17 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:20:17 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:20:17 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:20:17 user nova-compute[74646]:   </os>
Oct 26 16:20:17 user nova-compute[74646]:   <features>
Oct 26 16:20:17 user nova-compute[74646]:     <acpi/>
Oct 26 16:20:17 user nova-compute[74646]:     <apic/>
Oct 26 16:20:17 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:20:17 user nova-compute[74646]:   </features>
Oct 26 16:20:17 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:20:17 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:20:17 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:20:17 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:20:17 user nova-compute[74646]:   </clock>
Oct 26 16:20:17 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:20:17 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:20:17 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:20:17 user nova-compute[74646]:   </cpu>
Oct 26 16:20:17 user nova-compute[74646]:   <devices>
Oct 26 16:20:17 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:20:17 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:20:17 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk"/>
Oct 26 16:20:17 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:20:17 user nova-compute[74646]:     </disk>
Oct 26 16:20:17 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:20:17 user nova-compute[74646]:       <mac address="fa:16:3e:8e:f6:84"/>
Oct 26 16:20:17 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:20:17 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:20:17 user nova-compute[74646]:       <target dev="tap950d60ad-a0"/>
Oct 26 16:20:17 user nova-compute[74646]:     </interface>
Oct 26 16:20:17 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:20:17 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/console.log" append="off"/>
Oct 26 16:20:17 user nova-compute[74646]:     </serial>
Oct 26 16:20:17 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:20:17 user nova-compute[74646]:     <video>
Oct 26 16:20:17 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:20:17 user nova-compute[74646]:     </video>
Oct 26 16:20:17 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:20:17 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:20:17 user nova-compute[74646]:     </rng>
Oct 26 16:20:17 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:20:17 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:20:17 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:20:17 user nova-compute[74646]:     </memballoon>
Oct 26 16:20:17 user nova-compute[74646]:   </devices>
Oct 26 16:20:17 user nova-compute[74646]: </domain>
Oct 26 16:20:17 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-840508483',display_name='tempest-VolumesActionsTest-instance-840508483',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-840508483',id=44,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='59dd17f01a8043d78909861b4649cd76',ramdisk_id='',reservation_id='r-ut9id5ke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-684642585',owner_user_name='tempest-VolumesActionsTest-684642585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:20:16Z,user_data=None,user_id='2f2e62ec681748589c721f9dde24d2ba',uuid=c605a36d-d653-40d7-8fb1-cdcba29f3a19,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "address": "fa:16:3e:8e:f6:84", "network": {"id": "57cf5edc-e523-4732-afa0-02f452cc448a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601411552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59dd17f01a8043d78909861b4649cd76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950d60ad-a0", "ovs_interfaceid": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Converting VIF {"id": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "address": "fa:16:3e:8e:f6:84", "network": {"id": "57cf5edc-e523-4732-afa0-02f452cc448a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601411552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59dd17f01a8043d78909861b4649cd76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950d60ad-a0", "ovs_interfaceid": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f6:84,bridge_name='br-int',has_traffic_filtering=True,id=950d60ad-a0b7-4766-8da6-358a1ff3970f,network=Network(57cf5edc-e523-4732-afa0-02f452cc448a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950d60ad-a0') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG os_vif [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f6:84,bridge_name='br-int',has_traffic_filtering=True,id=950d60ad-a0b7-4766-8da6-358a1ff3970f,network=Network(57cf5edc-e523-4732-afa0-02f452cc448a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950d60ad-a0') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48bbe1db-8b57-5d22-afab-e3e42e22d462', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap950d60ad-a0, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap950d60ad-a0, col_values=(('qos', UUID('8ee536d1-8754-4a2e-9bcd-3a4e2a4383b1')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap950d60ad-a0, col_values=(('external_ids', {'iface-id': '950d60ad-a0b7-4766-8da6-358a1ff3970f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8e:f6:84', 'vm-uuid': 'c605a36d-d653-40d7-8fb1-cdcba29f3a19'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:17 user nova-compute[74646]: INFO os_vif [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f6:84,bridge_name='br-int',has_traffic_filtering=True,id=950d60ad-a0b7-4766-8da6-358a1ff3970f,network=Network(57cf5edc-e523-4732-afa0-02f452cc448a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950d60ad-a0')
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] No VIF found with MAC fa:16:3e:8e:f6:84, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.network.neutron [req-182c1ff2-de1b-43c8-b8dd-ca4fd1bb1319 req-4a3cbce1-859b-4924-be30-ec0ba42eb1b8 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Updated VIF entry in instance network info cache for port 950d60ad-a0b7-4766-8da6-358a1ff3970f. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG nova.network.neutron [req-182c1ff2-de1b-43c8-b8dd-ca4fd1bb1319 req-4a3cbce1-859b-4924-be30-ec0ba42eb1b8 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Updating instance_info_cache with network_info: [{"id": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "address": "fa:16:3e:8e:f6:84", "network": {"id": "57cf5edc-e523-4732-afa0-02f452cc448a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601411552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59dd17f01a8043d78909861b4649cd76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950d60ad-a0", "ovs_interfaceid": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:20:17 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-182c1ff2-de1b-43c8-b8dd-ca4fd1bb1319 req-4a3cbce1-859b-4924-be30-ec0ba42eb1b8 service nova] Releasing lock "refresh_cache-c605a36d-d653-40d7-8fb1-cdcba29f3a19" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:20:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-b9b2f33d-974b-4c2a-989e-e06045d609e5 req-e9e8ff4e-2d5e-4a46-9a0b-fb4a11574b4c service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Received event network-vif-plugged-950d60ad-a0b7-4766-8da6-358a1ff3970f {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b9b2f33d-974b-4c2a-989e-e06045d609e5 req-e9e8ff4e-2d5e-4a46-9a0b-fb4a11574b4c service nova] Acquiring lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b9b2f33d-974b-4c2a-989e-e06045d609e5 req-e9e8ff4e-2d5e-4a46-9a0b-fb4a11574b4c service nova] Lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-b9b2f33d-974b-4c2a-989e-e06045d609e5 req-e9e8ff4e-2d5e-4a46-9a0b-fb4a11574b4c service nova] Lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:19 user nova-compute[74646]: DEBUG nova.compute.manager [req-b9b2f33d-974b-4c2a-989e-e06045d609e5 req-e9e8ff4e-2d5e-4a46-9a0b-fb4a11574b4c service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] No waiting events found dispatching network-vif-plugged-950d60ad-a0b7-4766-8da6-358a1ff3970f {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:20:19 user nova-compute[74646]: WARNING nova.compute.manager [req-b9b2f33d-974b-4c2a-989e-e06045d609e5 req-e9e8ff4e-2d5e-4a46-9a0b-fb4a11574b4c service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Received unexpected event network-vif-plugged-950d60ad-a0b7-4766-8da6-358a1ff3970f for instance with vm_state building and task_state spawning.
Oct 26 16:20:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:20 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:20:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:20:20 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Instance spawned successfully.
Oct 26 16:20:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:20:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:20:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:20:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:20:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:20:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:20:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:20:21 user nova-compute[74646]: INFO nova.compute.manager [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Took 4.85 seconds to spawn the instance on the hypervisor.
Oct 26 16:20:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:20:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-5da51162-6024-470e-938d-eaffe1972cf7 req-ddc68d65-3e95-4132-8f68-8034a5b61c87 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Received event network-vif-plugged-950d60ad-a0b7-4766-8da6-358a1ff3970f {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5da51162-6024-470e-938d-eaffe1972cf7 req-ddc68d65-3e95-4132-8f68-8034a5b61c87 service nova] Acquiring lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5da51162-6024-470e-938d-eaffe1972cf7 req-ddc68d65-3e95-4132-8f68-8034a5b61c87 service nova] Lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5da51162-6024-470e-938d-eaffe1972cf7 req-ddc68d65-3e95-4132-8f68-8034a5b61c87 service nova] Lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:21 user nova-compute[74646]: DEBUG nova.compute.manager [req-5da51162-6024-470e-938d-eaffe1972cf7 req-ddc68d65-3e95-4132-8f68-8034a5b61c87 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] No waiting events found dispatching network-vif-plugged-950d60ad-a0b7-4766-8da6-358a1ff3970f {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:20:21 user nova-compute[74646]: WARNING nova.compute.manager [req-5da51162-6024-470e-938d-eaffe1972cf7 req-ddc68d65-3e95-4132-8f68-8034a5b61c87 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Received unexpected event network-vif-plugged-950d60ad-a0b7-4766-8da6-358a1ff3970f for instance with vm_state building and task_state spawning.
Oct 26 16:20:21 user nova-compute[74646]: INFO nova.compute.manager [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Took 5.90 seconds to build instance.
Oct 26 16:20:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-6a752014-47be-4dac-abb7-479fe867b86a tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.205s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:27 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Calling os-brick to attach iSCSI Volume {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDfRGgkj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:20:31 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:20:31 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:20:31 user nova-compute[74646]: INFO os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b2367a3-1026-42d6-9a34-52cae51caeba]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 26 16:20:31 user nova-compute[74646]:  {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --interface default --op new {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9be8a84-6e2c-4830-8269-bc3dfa89fff7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f] added\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f] added
Oct 26 16:20:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d9619e-eb63-4dc7-bb04-546d62d0d3e0]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c92c5f8-a76d-4740-b969-a682933a1691]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDfRGgkj {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HDfRGgkj" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ef002b-e0fe-4e62-bb11-12d0d1f5d67a]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HDfRGgkj'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db2cd53-1187-47dc-96bb-889606c5dd64]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f29008-aab8-452f-88ea-fae237d51614]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:20:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:20:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --login {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cd8469-d074-40f6-8cbe-e6de76a69ca6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f, portal: 172.16.0.220,3260]
Oct 26 16:20:31 user nova-compute[74646]: Login to [iface: default, target: iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f, portal: 172.16.0.220,3260] successful.
Oct 26 16:20:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[9333fb8c-12dd-48bb-b2e3-c042da9416be]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f92c28d-ae24-4343-9c82-d3c349c96a85]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:20:31 user nova-compute[74646]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f (non-flash)
Oct 26 16:20:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:20:31 user nova-compute[74646]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f (non-flash)
Oct 26 16:20:31 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Connected to 172.16.0.220:3260 {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74646) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74646) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[322f200f-f32f-496c-a03b-d636ff069f09]: (4, ('- - 0', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74646) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 26 16:20:31 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDfRGgkj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74646) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 26 16:20:32 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:20:32 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26261396361326537', 'path': '/dev/sdc'} {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:20:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26261396361326537', 'path': '/dev/sdc'} {{(pid=74646) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 26 16:20:32 user nova-compute[74646]: DEBUG nova.objects.instance [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lazy-loading 'flavor' on Instance uuid 379252a5-ba76-4593-b792-ae426aa52104 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:20:32 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] attach device xml: <disk type="block" device="disk">
Oct 26 16:20:32 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:20:32 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 16:20:32 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:20:32 user nova-compute[74646]:   <serial>798b66f7-48d9-427f-ba1b-311a3430ab0f</serial>
Oct 26 16:20:32 user nova-compute[74646]: </disk>
Oct 26 16:20:32 user nova-compute[74646]:  {{(pid=74646) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 26 16:20:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:20:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:20:33 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] No VIF found with MAC fa:16:3e:15:d2:8d, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:20:33 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-34ce509d-6dad-4834-b1b6-785dd150968e tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "379252a5-ba76-4593-b792-ae426aa52104" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.191s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "379252a5-ba76-4593-b792-ae426aa52104" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:34 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "379252a5-ba76-4593-b792-ae426aa52104" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:34 user nova-compute[74646]: INFO nova.compute.manager [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Detaching volume 798b66f7-48d9-427f-ba1b-311a3430ab0f
Oct 26 16:20:34 user nova-compute[74646]: INFO nova.virt.block_device [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Attempting to driver detach volume 798b66f7-48d9-427f-ba1b-311a3430ab0f from mountpoint /dev/vdb
Oct 26 16:20:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Attempting to detach device vdb from instance 379252a5-ba76-4593-b792-ae426aa52104 from the persistent domain config. {{(pid=74646) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 26 16:20:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:20:34 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:20:34 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 16:20:34 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:20:34 user nova-compute[74646]:   <serial>798b66f7-48d9-427f-ba1b-311a3430ab0f</serial>
Oct 26 16:20:34 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:20:34 user nova-compute[74646]: </disk>
Oct 26 16:20:34 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:20:34 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Successfully detached device vdb from instance 379252a5-ba76-4593-b792-ae426aa52104 from the persistent domain config.
Oct 26 16:20:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 379252a5-ba76-4593-b792-ae426aa52104 from the live domain config. {{(pid=74646) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 26 16:20:34 user nova-compute[74646]: DEBUG nova.virt.libvirt.guest [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] detach device xml: <disk type="block" device="disk">
Oct 26 16:20:34 user nova-compute[74646]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 26 16:20:34 user nova-compute[74646]:   <source dev="/dev/sdc"/>
Oct 26 16:20:34 user nova-compute[74646]:   <target dev="vdb" bus="virtio"/>
Oct 26 16:20:34 user nova-compute[74646]:   <serial>798b66f7-48d9-427f-ba1b-311a3430ab0f</serial>
Oct 26 16:20:34 user nova-compute[74646]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 26 16:20:34 user nova-compute[74646]: </disk>
Oct 26 16:20:34 user nova-compute[74646]:  {{(pid=74646) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 26 16:20:35 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 379252a5-ba76-4593-b792-ae426aa52104 {{(pid=74646) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 26 16:20:36 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:39 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:20:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:20:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:20:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:20:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "refresh_cache-379252a5-ba76-4593-b792-ae426aa52104" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:20:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquired lock "refresh_cache-379252a5-ba76-4593-b792-ae426aa52104" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:20:40 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Forcefully refreshing network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Oct 26 16:20:40 user nova-compute[74646]: DEBUG nova.network.neutron [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Updating instance_info_cache with network_info: [{"id": "8001b20b-8c82-4b75-873f-8438e94014e8", "address": "fa:16:3e:15:d2:8d", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8001b20b-8c", "ovs_interfaceid": "8001b20b-8c82-4b75-873f-8438e94014e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:20:40 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Releasing lock "refresh_cache-379252a5-ba76-4593-b792-ae426aa52104" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:20:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Updated the network info_cache for instance {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 26 16:20:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:20:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:20:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:20:41 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:43 user nova-compute[74646]: INFO nova.compute.manager [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Terminating instance
Oct 26 16:20:43 user nova-compute[74646]: DEBUG nova.compute.manager [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG nova.compute.manager [req-fe662d39-152d-4b24-a581-ac3cbdc84459 req-7f3e2687-a2f8-4a70-a8e5-b4e4ad5847a2 service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-unplugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fe662d39-152d-4b24-a581-ac3cbdc84459 req-7f3e2687-a2f8-4a70-a8e5-b4e4ad5847a2 service nova] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fe662d39-152d-4b24-a581-ac3cbdc84459 req-7f3e2687-a2f8-4a70-a8e5-b4e4ad5847a2 service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-fe662d39-152d-4b24-a581-ac3cbdc84459 req-7f3e2687-a2f8-4a70-a8e5-b4e4ad5847a2 service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG nova.compute.manager [req-fe662d39-152d-4b24-a581-ac3cbdc84459 req-7f3e2687-a2f8-4a70-a8e5-b4e4ad5847a2 service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] No waiting events found dispatching network-vif-unplugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:20:43 user nova-compute[74646]: DEBUG nova.compute.manager [req-fe662d39-152d-4b24-a581-ac3cbdc84459 req-7f3e2687-a2f8-4a70-a8e5-b4e4ad5847a2 service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-unplugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Instance destroyed successfully.
Oct 26 16:20:44 user nova-compute[74646]: DEBUG nova.objects.instance [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lazy-loading 'resources' on Instance uuid ed415bf2-5b3a-4b37-b069-7d206f0d6700 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-26T16:16:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1909920837',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-508729915',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0IqpbEUj9FTXwsltPcQQxE3mw3HOun3lOf6u+YSQ0CcyJV6/G/ONdi3SGnlhdvJqfyz0BhUnqVGVb/CKZrfcM/4Xw4szISMudN+QKZ31ox5/FMuTnBsO4uIsAc0O90zg==',key_name='tempest-keypair-341580469',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:19:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bffc92069c704c6fac59cda13fa72e52',ramdisk_id='',reservation_id='r-7wch87hx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1491440656',owner_user_name='tempest-ServerActionsV293TestJSON-1491440656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:19:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='726dd5eaa0cd45ada546ac68fe04ef40',uuid=ed415bf2-5b3a-4b37-b069-7d206f0d6700,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Converting VIF {"id": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "address": "fa:16:3e:ae:3c:86", "network": {"id": "e5675dc6-92c8-465e-a116-18c24d116464", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1608059810-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bffc92069c704c6fac59cda13fa72e52", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26d80c0f-40", "ovs_interfaceid": "26d80c0f-407c-453c-94b9-8a19b9a0b11e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:86,bridge_name='br-int',has_traffic_filtering=True,id=26d80c0f-407c-453c-94b9-8a19b9a0b11e,network=Network(e5675dc6-92c8-465e-a116-18c24d116464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26d80c0f-40') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_vif [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:86,bridge_name='br-int',has_traffic_filtering=True,id=26d80c0f-407c-453c-94b9-8a19b9a0b11e,network=Network(e5675dc6-92c8-465e-a116-18c24d116464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26d80c0f-40') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26d80c0f-40, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2050d8b8-1352-484e-a856-d6051b9ebb18) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: INFO os_vif [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:3c:86,bridge_name='br-int',has_traffic_filtering=True,id=26d80c0f-407c-453c-94b9-8a19b9a0b11e,network=Network(e5675dc6-92c8-465e-a116-18c24d116464),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26d80c0f-40')
Oct 26 16:20:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iSmuCPNh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:20:44 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[a004eeea-51f1-465f-b2d4-1b9f2eed0160]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:20:44 user nova-compute[74646]: No targets found.
Oct 26 16:20:44 user nova-compute[74646]: iSNS:
Oct 26 16:20:44 user nova-compute[74646]: No targets found.
Oct 26 16:20:44 user nova-compute[74646]: STATIC:
Oct 26 16:20:44 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c
Oct 26 16:20:44 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:20:44 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:20:44 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f
Oct 26 16:20:44 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:20:44 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:20:44 user nova-compute[74646]: FIRMWARE:
Oct 26 16:20:44 user nova-compute[74646]: No targets found.
Oct 26 16:20:44 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:20:44 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:20:44 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[49320177-820c-494a-889b-aaea06f9dad7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3ef0ef-4c07-4536-8746-7c70f01a68dd]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:20:44 user nova-compute[74646]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f (non-flash)
Oct 26 16:20:44 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c (non-flash)
Oct 26 16:20:44 user nova-compute[74646]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f (non-flash)
Oct 26 16:20:44 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d044c5e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c'): ({'sdb'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Removing single pathed devices sdb {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.034s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34a673f-611f-4c25-8aa7-c91df0828879]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe28555-ed31-48d9-ae27-7f7c6132c097]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Flushing IO for device /dev/sdb {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabc7a2e-53dc-4fac-9553-201f3701a2b7]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed6e279-352b-4348-9677-5705f99cc5c1]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] SCSI volumes sdb have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOd19dacc7-f259e87420869138', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d19dacc7', '/dev/disk/by-id/scsi-26632353965383734') {{(pid=85624) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edf1774-4705-4f8c-95b6-ccb81270001c]: (4, None) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d0a6ef1-6b85-43af-9c50-90c1ca14e578]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[518b9017-a8ea-4e73-8050-3525a1c1b768]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260]
Oct 26 16:20:44 user nova-compute[74646]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c, portal: 172.16.0.220,3260] successful.
Oct 26 16:20:44 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9a126a47-5333-4520-aac0-f6982c44715c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[863aecc4-df01-4e51-8634-545918230707]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] <== disconnect_volume: return (346ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:20:44 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Deleting instance files /opt/stack/data/nova/instances/ed415bf2-5b3a-4b37-b069-7d206f0d6700_del
Oct 26 16:20:44 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Deletion of /opt/stack/data/nova/instances/ed415bf2-5b3a-4b37-b069-7d206f0d6700_del complete
Oct 26 16:20:44 user nova-compute[74646]: INFO nova.compute.manager [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Took 1.23 seconds to destroy the instance on the hypervisor.
Oct 26 16:20:44 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:44 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:20:45 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Took 0.78 seconds to deallocate network for instance.
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] No waiting events found dispatching network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:20:45 user nova-compute[74646]: WARNING nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received unexpected event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e for instance with vm_state active and task_state deleting.
Oct 26 16:20:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] No waiting events found dispatching network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:20:45 user nova-compute[74646]: WARNING nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received unexpected event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e for instance with vm_state active and task_state deleting.
Oct 26 16:20:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] No waiting events found dispatching network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:20:45 user nova-compute[74646]: WARNING nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received unexpected event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e for instance with vm_state active and task_state deleting.
Oct 26 16:20:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-unplugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] No waiting events found dispatching network-vif-unplugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-unplugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Acquiring lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] No waiting events found dispatching network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:20:45 user nova-compute[74646]: WARNING nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received unexpected event network-vif-plugged-26d80c0f-407c-453c-94b9-8a19b9a0b11e for instance with vm_state active and task_state deleting.
Oct 26 16:20:45 user nova-compute[74646]: DEBUG nova.compute.manager [req-033cf52f-d02e-4ace-9cd7-b6382ecaa3c5 req-7a45829b-ed08-498c-a04e-64c4d97408dc service nova] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Received event network-vif-deleted-26d80c0f-407c-453c-94b9-8a19b9a0b11e {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:46 user nova-compute[74646]: INFO nova.compute.manager [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Took 1.24 seconds to detach 1 volumes for instance.
Oct 26 16:20:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] [instance: ed415bf2-5b3a-4b37-b069-7d206f0d6700] Deleting volume: 9a126a47-5333-4520-aac0-f6982c44715c {{(pid=74646) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 26 16:20:46 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:20:46 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:20:46 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8665MB free_disk=25.261585235595703GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance ed415bf2-5b3a-4b37-b069-7d206f0d6700 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 379252a5-ba76-4593-b792-ae426aa52104 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance c605a36d-d653-40d7-8fb1-cdcba29f3a19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.248s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.143s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:20:47 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:20:47 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:20:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:47 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Deleted allocations for instance ed415bf2-5b3a-4b37-b069-7d206f0d6700
Oct 26 16:20:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-3a6afb90-e6cd-4fd5-b219-0b27f564b823 tempest-ServerActionsV293TestJSON-1491440656 tempest-ServerActionsV293TestJSON-1491440656-project-member] Lock "ed415bf2-5b3a-4b37-b069-7d206f0d6700" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.870s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:49 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:50 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:20:50 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:20:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:54 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:55 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 379252a5-ba76-4593-b792-ae426aa52104 is timed out.
Oct 26 16:20:55 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Successfully detached device vdb from instance 379252a5-ba76-4593-b792-ae426aa52104 from the live domain config.
Oct 26 16:20:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] calling os-brick to detach iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7ff9d07308e0>, {'target_iqn': 'iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HDfRGgkj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 26 16:20:55 user nova-compute[74646]: WARNING os_brick.initiator.connectors.base [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[95531f11-5b9e-4983-b17e-f0f0b7758a75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 26 16:20:55 user nova-compute[74646]: No targets found.
Oct 26 16:20:55 user nova-compute[74646]: iSNS:
Oct 26 16:20:55 user nova-compute[74646]: No targets found.
Oct 26 16:20:55 user nova-compute[74646]: STATIC:
Oct 26 16:20:55 user nova-compute[74646]: Target: iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f
Oct 26 16:20:55 user nova-compute[74646]:         Portal: 172.16.0.220:3260,-1
Oct 26 16:20:55 user nova-compute[74646]:                 Iface Name: default
Oct 26 16:20:55 user nova-compute[74646]: FIRMWARE:
Oct 26 16:20:55 user nova-compute[74646]: No targets found.
Oct 26 16:20:55 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 26 16:20:55 user nova-compute[74646]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 26 16:20:55 user nova-compute[74646]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74646) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f', 0)] {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3680962b-1d05-462d-ad68-fec09c7e532d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4452694-bfe2-408a-9b15-78abc1d8d6ad]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f (non-flash)\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f (non-flash)
Oct 26 16:20:55 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f (non-flash)
Oct 26 16:20:55 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7ff9d031f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f'): ({'sdc'}, set())}) {{(pid=74646) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Removing single pathed devices sdc {{(pid=74646) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[3834fca0-63fa-48bb-afb2-4005af8254f9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9bff6fa-1d92-421c-9cea-a4a08ad4be3e]: (4, ('ok\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Flushing IO for device /dev/sdc {{(pid=74646) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[091a41f0-5ebc-4efc-80c2-f632122443c7]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74646) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c0a2af-1335-42bd-a018-80351d4afc37]: (4, ('1', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.linuxscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] SCSI volumes sdc have been removed. {{(pid=74646) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f')] {{(pid=74646) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[e94e0191-2a2d-4850-8ecf-2ded21814da0]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --logout {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b602920-51ec-452f-bc97-21aeb5fc4cbf]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f, portal: 172.16.0.220,3260]
Oct 26 16:20:55 user nova-compute[74646]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f, portal: 172.16.0.220,3260] successful.
Oct 26 16:20:55 user nova-compute[74646]:  stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --op delete {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:798b66f7-48d9-427f-ba1b-311a3430ab0f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85624) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2843713-75f1-403c-bd21-fea065f9903e]: (4, ('', '')) {{(pid=85624) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74646) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.base [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG os_brick.initiator.connectors.iscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] <== disconnect_volume: return (317ms) None {{(pid=74646) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 26 16:20:55 user nova-compute[74646]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Disconnected iSCSI Volume {{(pid=74646) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 26 16:20:56 user nova-compute[74646]: DEBUG nova.objects.instance [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lazy-loading 'flavor' on Instance uuid 379252a5-ba76-4593-b792-ae426aa52104 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:20:56 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-5e0e7f01-2ce0-40fb-9a04-53ae04d7c78f tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "379252a5-ba76-4593-b792-ae426aa52104" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.796s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:20:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:20:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:20:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 16:20:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:20:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:20:59 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:21:04 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:21:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:21:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:21:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74646) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 26 16:21:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:21:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74646) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 26 16:21:09 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:14 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:19 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "379252a5-ba76-4593-b792-ae426aa52104" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "379252a5-ba76-4593-b792-ae426aa52104" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "379252a5-ba76-4593-b792-ae426aa52104-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "379252a5-ba76-4593-b792-ae426aa52104-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "379252a5-ba76-4593-b792-ae426aa52104-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:24 user nova-compute[74646]: INFO nova.compute.manager [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Terminating instance
Oct 26 16:21:24 user nova-compute[74646]: DEBUG nova.compute.manager [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:21:24 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-bc269fcf-6b0b-476c-9e19-ca467bf2e2fa req-7576e0f2-c67f-495f-b0d7-10330e4ef131 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Received event network-vif-unplugged-8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-bc269fcf-6b0b-476c-9e19-ca467bf2e2fa req-7576e0f2-c67f-495f-b0d7-10330e4ef131 service nova] Acquiring lock "379252a5-ba76-4593-b792-ae426aa52104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-bc269fcf-6b0b-476c-9e19-ca467bf2e2fa req-7576e0f2-c67f-495f-b0d7-10330e4ef131 service nova] Lock "379252a5-ba76-4593-b792-ae426aa52104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-bc269fcf-6b0b-476c-9e19-ca467bf2e2fa req-7576e0f2-c67f-495f-b0d7-10330e4ef131 service nova] Lock "379252a5-ba76-4593-b792-ae426aa52104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-bc269fcf-6b0b-476c-9e19-ca467bf2e2fa req-7576e0f2-c67f-495f-b0d7-10330e4ef131 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] No waiting events found dispatching network-vif-unplugged-8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-bc269fcf-6b0b-476c-9e19-ca467bf2e2fa req-7576e0f2-c67f-495f-b0d7-10330e4ef131 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Received event network-vif-unplugged-8001b20b-8c82-4b75-873f-8438e94014e8 for instance with task_state deleting. {{(pid=74646) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 26 16:21:25 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Instance destroyed successfully.
Oct 26 16:21:25 user nova-compute[74646]: DEBUG nova.objects.instance [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lazy-loading 'resources' on Instance uuid 379252a5-ba76-4593-b792-ae426aa52104 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:18:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1578994054',display_name='tempest-AttachVolumeNegativeTest-server-1578994054',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1578994054',id=43,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPJebpDBcfVEYPK/q/sonF2GnzZNxHX2rXz6z6PuXRNsIG6MpVCEHXszGQRdW4w2SOPafGrpHxfoYjP84zJRSLyu7gEhSIzxpXn8quVFcpgSDSQboQd/pYIVQK5hXbWj4Q==',key_name='tempest-keypair-1017207549',keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:18:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f24b251085ed49c991eef6c2df0b0990',ramdisk_id='',reservation_id='r-2nns8n1f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-340789388',owner_user_name='tempest-AttachVolumeNegativeTest-340789388-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:18:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41c8a2a8c5594cca9451ab93e681dcd0',uuid=379252a5-ba76-4593-b792-ae426aa52104,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8001b20b-8c82-4b75-873f-8438e94014e8", "address": "fa:16:3e:15:d2:8d", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8001b20b-8c", "ovs_interfaceid": "8001b20b-8c82-4b75-873f-8438e94014e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converting VIF {"id": "8001b20b-8c82-4b75-873f-8438e94014e8", "address": "fa:16:3e:15:d2:8d", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8001b20b-8c", "ovs_interfaceid": "8001b20b-8c82-4b75-873f-8438e94014e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:d2:8d,bridge_name='br-int',has_traffic_filtering=True,id=8001b20b-8c82-4b75-873f-8438e94014e8,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8001b20b-8c') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG os_vif [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:d2:8d,bridge_name='br-int',has_traffic_filtering=True,id=8001b20b-8c82-4b75-873f-8438e94014e8,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8001b20b-8c') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8001b20b-8c, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8507695a-613a-45b8-a87b-1c349f291387) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:25 user nova-compute[74646]: INFO os_vif [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:d2:8d,bridge_name='br-int',has_traffic_filtering=True,id=8001b20b-8c82-4b75-873f-8438e94014e8,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8001b20b-8c')
Oct 26 16:21:25 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Deleting instance files /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104_del
Oct 26 16:21:25 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Deletion of /opt/stack/data/nova/instances/379252a5-ba76-4593-b792-ae426aa52104_del complete
Oct 26 16:21:25 user nova-compute[74646]: INFO nova.compute.manager [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Took 0.83 seconds to destroy the instance on the hypervisor.
Oct 26 16:21:25 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:21:25 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 379252a5-ba76-4593-b792-ae426aa52104] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:21:26 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:21:26 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Took 0.67 seconds to deallocate network for instance.
Oct 26 16:21:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-e2359fa2-8a11-4b4a-acd6-af8a14c2c258 req-f7f2f999-1937-4d7b-92fb-d1e5a97c73d2 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Received event network-vif-deleted-8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:21:26 user nova-compute[74646]: INFO nova.compute.manager [req-e2359fa2-8a11-4b4a-acd6-af8a14c2c258 req-f7f2f999-1937-4d7b-92fb-d1e5a97c73d2 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Neutron deleted interface 8001b20b-8c82-4b75-873f-8438e94014e8; detaching it from the instance and deleting it from the info cache
Oct 26 16:21:26 user nova-compute[74646]: DEBUG nova.network.neutron [req-e2359fa2-8a11-4b4a-acd6-af8a14c2c258 req-f7f2f999-1937-4d7b-92fb-d1e5a97c73d2 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:21:26 user nova-compute[74646]: DEBUG nova.compute.manager [req-e2359fa2-8a11-4b4a-acd6-af8a14c2c258 req-f7f2f999-1937-4d7b-92fb-d1e5a97c73d2 service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Detach interface failed, port_id=8001b20b-8c82-4b75-873f-8438e94014e8, reason: Instance 379252a5-ba76-4593-b792-ae426aa52104 could not be found. {{(pid=74646) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 26 16:21:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:26 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:21:26 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:21:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:26 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Deleted allocations for instance 379252a5-ba76-4593-b792-ae426aa52104
Oct 26 16:21:26 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-b91d937b-b86a-4c27-bd93-c5a7e9688a12 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "379252a5-ba76-4593-b792-ae426aa52104" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.867s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-a215eb1e-33aa-465c-8633-4b9b88461e7b req-089bb985-cf4a-4e69-a8fd-b315b662883c service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Received event network-vif-plugged-8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:21:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a215eb1e-33aa-465c-8633-4b9b88461e7b req-089bb985-cf4a-4e69-a8fd-b315b662883c service nova] Acquiring lock "379252a5-ba76-4593-b792-ae426aa52104-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a215eb1e-33aa-465c-8633-4b9b88461e7b req-089bb985-cf4a-4e69-a8fd-b315b662883c service nova] Lock "379252a5-ba76-4593-b792-ae426aa52104-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:27 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a215eb1e-33aa-465c-8633-4b9b88461e7b req-089bb985-cf4a-4e69-a8fd-b315b662883c service nova] Lock "379252a5-ba76-4593-b792-ae426aa52104-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:27 user nova-compute[74646]: DEBUG nova.compute.manager [req-a215eb1e-33aa-465c-8633-4b9b88461e7b req-089bb985-cf4a-4e69-a8fd-b315b662883c service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] No waiting events found dispatching network-vif-plugged-8001b20b-8c82-4b75-873f-8438e94014e8 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:21:27 user nova-compute[74646]: WARNING nova.compute.manager [req-a215eb1e-33aa-465c-8633-4b9b88461e7b req-089bb985-cf4a-4e69-a8fd-b315b662883c service nova] [instance: 379252a5-ba76-4593-b792-ae426aa52104] Received unexpected event network-vif-plugged-8001b20b-8c82-4b75-873f-8438e94014e8 for instance with vm_state deleted and task_state None.
Oct 26 16:21:30 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:35 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:21:37 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:21:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Starting heal instance info cache {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 26 16:21:40 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Didn't find any instances for network info cache update. {{(pid=74646) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 26 16:21:40 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:21:40 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:41 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:21:41 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:21:41 user nova-compute[74646]: DEBUG nova.compute.manager [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74646) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 26 16:21:42 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:43 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:21:43 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Acquiring lock "d3531167-c8a6-49b9-94af-90a95e6fd077" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "d3531167-c8a6-49b9-94af-90a95e6fd077" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG nova.compute.manager [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:21:45 user nova-compute[74646]: INFO nova.compute.claims [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Claim successful on node user
Oct 26 16:21:45 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.216s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG nova.compute.manager [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG nova.compute.manager [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG nova.network.neutron [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:21:45 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:21:45 user nova-compute[74646]: DEBUG nova.compute.manager [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG nova.compute.manager [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:21:45 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Creating image(s)
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3531167-c8a6-49b9-94af-90a95e6fd077/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "/opt/stack/data/nova/instances/d3531167-c8a6-49b9-94af-90a95e6fd077/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "/opt/stack/data/nova/instances/d3531167-c8a6-49b9-94af-90a95e6fd077/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG nova.policy [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b2d40e3a9404928a4c4d9dfb2356df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfed3c05e17482eaf314e0ab7cc1b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.187s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Acquiring lock "0854c91c-fa7c-465e-83f5-3926305417fc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "0854c91c-fa7c-465e-83f5-3926305417fc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.174s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/d3531167-c8a6-49b9-94af-90a95e6fd077/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/d3531167-c8a6-49b9-94af-90a95e6fd077/disk 1073741824" returned: 0 in 0.059s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:45 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:21:46 user nova-compute[74646]: INFO nova.compute.claims [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Claim successful on node user
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.179s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3531167-c8a6-49b9-94af-90a95e6fd077/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3531167-c8a6-49b9-94af-90a95e6fd077/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.network.neutron [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Successfully created port: e2b76174-08e5-4617-bbcd-3ff30cb77286 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3531167-c8a6-49b9-94af-90a95e6fd077/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Cannot resize image /opt/stack/data/nova/instances/d3531167-c8a6-49b9-94af-90a95e6fd077/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Ensure instance console log exists: /opt/stack/data/nova/instances/d3531167-c8a6-49b9-94af-90a95e6fd077/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager.update_available_resource {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Auditing locally available compute resources for user (node: user) {{(pid=74646) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:21:46 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.policy [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b2d40e3a9404928a4c4d9dfb2356df8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8dfed3c05e17482eaf314e0ab7cc1b83', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:21:46 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Creating image(s)
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Acquiring lock "/opt/stack/data/nova/instances/0854c91c-fa7c-465e-83f5-3926305417fc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "/opt/stack/data/nova/instances/0854c91c-fa7c-465e-83f5-3926305417fc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "/opt/stack/data/nova/instances/0854c91c-fa7c-465e-83f5-3926305417fc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.171s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.network.neutron [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Successfully updated port: e2b76174-08e5-4617-bbcd-3ff30cb77286 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Acquiring lock "refresh_cache-d3531167-c8a6-49b9-94af-90a95e6fd077" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Acquired lock "refresh_cache-d3531167-c8a6-49b9-94af-90a95e6fd077" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.network.neutron [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.compute.manager [req-119fd5de-819d-4a83-9f1a-4dcdf7b17635 req-d20c19b6-0140-452c-ae84-4be44d63c9e4 service nova] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Received event network-changed-e2b76174-08e5-4617-bbcd-3ff30cb77286 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG nova.compute.manager [req-119fd5de-819d-4a83-9f1a-4dcdf7b17635 req-d20c19b6-0140-452c-ae84-4be44d63c9e4 service nova] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Refreshing instance network info cache due to event network-changed-e2b76174-08e5-4617-bbcd-3ff30cb77286. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-119fd5de-819d-4a83-9f1a-4dcdf7b17635 req-d20c19b6-0140-452c-ae84-4be44d63c9e4 service nova] Acquiring lock "refresh_cache-d3531167-c8a6-49b9-94af-90a95e6fd077" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:21:46 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Successfully created port: 830e8644-be9b-4687-880b-1da4629de476 {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.network.neutron [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.489s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/0854c91c-fa7c-465e-83f5-3926305417fc/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/0854c91c-fa7c-465e-83f5-3926305417fc/disk 1073741824" returned: 0 in 0.047s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.541s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:21:47 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:21:47 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Hypervisor/Node resource view: name=user free_ram=8924MB free_disk=25.286521911621094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74646) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance c605a36d-d653-40d7-8fb1-cdcba29f3a19 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance d3531167-c8a6-49b9-94af-90a95e6fd077 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Instance 0854c91c-fa7c-465e-83f5-3926305417fc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74646) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74646) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.183s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0854c91c-fa7c-465e-83f5-3926305417fc/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0854c91c-fa7c-465e-83f5-3926305417fc/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.network.neutron [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Updating instance_info_cache with network_info: [{"id": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "address": "fa:16:3e:0c:5b:6a", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b76174-08", "ovs_interfaceid": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Releasing lock "refresh_cache-d3531167-c8a6-49b9-94af-90a95e6fd077" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.compute.manager [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Instance network_info: |[{"id": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "address": "fa:16:3e:0c:5b:6a", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b76174-08", "ovs_interfaceid": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-119fd5de-819d-4a83-9f1a-4dcdf7b17635 req-d20c19b6-0140-452c-ae84-4be44d63c9e4 service nova] Acquired lock "refresh_cache-d3531167-c8a6-49b9-94af-90a95e6fd077" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.network.neutron [req-119fd5de-819d-4a83-9f1a-4dcdf7b17635 req-d20c19b6-0140-452c-ae84-4be44d63c9e4 service nova] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Refreshing network info cache for port e2b76174-08e5-4617-bbcd-3ff30cb77286 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Start _get_guest_xml network_info=[{"id": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "address": "fa:16:3e:0c:5b:6a", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b76174-08", "ovs_interfaceid": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:21:47 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:21:47 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-488113707',display_name='tempest-ServerRescueNegativeTestJSON-server-488113707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-488113707',id=45,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dfed3c05e17482eaf314e0ab7cc1b83',ramdisk_id='',reservation_id='r-p7lalb6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-529562052',owner_user_name='tempest-ServerRescueNegativeTestJSON-529562052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:21:45Z,user_data=None,user_id='5b2d40e3a9404928a4c4d9dfb2356df8',uuid=d3531167-c8a6-49b9-94af-90a95e6fd077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "address": "fa:16:3e:0c:5b:6a", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b76174-08", "ovs_interfaceid": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Converting VIF {"id": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "address": "fa:16:3e:0c:5b:6a", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b76174-08", "ovs_interfaceid": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:5b:6a,bridge_name='br-int',has_traffic_filtering=True,id=e2b76174-08e5-4617-bbcd-3ff30cb77286,network=Network(8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b76174-08') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.objects.instance [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lazy-loading 'pci_devices' on Instance uuid d3531167-c8a6-49b9-94af-90a95e6fd077 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:21:47 user nova-compute[74646]:   <uuid>d3531167-c8a6-49b9-94af-90a95e6fd077</uuid>
Oct 26 16:21:47 user nova-compute[74646]:   <name>instance-0000002d</name>
Oct 26 16:21:47 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:21:47 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:21:47 user nova-compute[74646]:   <metadata>
Oct 26 16:21:47 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:21:47 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:21:47 user nova-compute[74646]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-488113707</nova:name>
Oct 26 16:21:47 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:21:47</nova:creationTime>
Oct 26 16:21:47 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:21:47 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:21:47 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:21:47 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:21:47 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:21:47 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:21:47 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:21:47 user nova-compute[74646]:       <nova:owner>
Oct 26 16:21:47 user nova-compute[74646]:         <nova:user uuid="5b2d40e3a9404928a4c4d9dfb2356df8">tempest-ServerRescueNegativeTestJSON-529562052-project-member</nova:user>
Oct 26 16:21:47 user nova-compute[74646]:         <nova:project uuid="8dfed3c05e17482eaf314e0ab7cc1b83">tempest-ServerRescueNegativeTestJSON-529562052</nova:project>
Oct 26 16:21:47 user nova-compute[74646]:       </nova:owner>
Oct 26 16:21:47 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:21:47 user nova-compute[74646]:       <nova:ports>
Oct 26 16:21:47 user nova-compute[74646]:         <nova:port uuid="e2b76174-08e5-4617-bbcd-3ff30cb77286">
Oct 26 16:21:47 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 16:21:47 user nova-compute[74646]:         </nova:port>
Oct 26 16:21:47 user nova-compute[74646]:       </nova:ports>
Oct 26 16:21:47 user nova-compute[74646]:     </nova:instance>
Oct 26 16:21:47 user nova-compute[74646]:   </metadata>
Oct 26 16:21:47 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:21:47 user nova-compute[74646]:     <system>
Oct 26 16:21:47 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:21:47 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:21:47 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:21:47 user nova-compute[74646]:       <entry name="serial">d3531167-c8a6-49b9-94af-90a95e6fd077</entry>
Oct 26 16:21:47 user nova-compute[74646]:       <entry name="uuid">d3531167-c8a6-49b9-94af-90a95e6fd077</entry>
Oct 26 16:21:47 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:21:47 user nova-compute[74646]:     </system>
Oct 26 16:21:47 user nova-compute[74646]:   </sysinfo>
Oct 26 16:21:47 user nova-compute[74646]:   <os>
Oct 26 16:21:47 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:21:47 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:21:47 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:21:47 user nova-compute[74646]:   </os>
Oct 26 16:21:47 user nova-compute[74646]:   <features>
Oct 26 16:21:47 user nova-compute[74646]:     <acpi/>
Oct 26 16:21:47 user nova-compute[74646]:     <apic/>
Oct 26 16:21:47 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:21:47 user nova-compute[74646]:   </features>
Oct 26 16:21:47 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:21:47 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:21:47 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:21:47 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:21:47 user nova-compute[74646]:   </clock>
Oct 26 16:21:47 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:21:47 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:21:47 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:21:47 user nova-compute[74646]:   </cpu>
Oct 26 16:21:47 user nova-compute[74646]:   <devices>
Oct 26 16:21:47 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:21:47 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:21:47 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/d3531167-c8a6-49b9-94af-90a95e6fd077/disk"/>
Oct 26 16:21:47 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:21:47 user nova-compute[74646]:     </disk>
Oct 26 16:21:47 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:21:47 user nova-compute[74646]:       <mac address="fa:16:3e:0c:5b:6a"/>
Oct 26 16:21:47 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:21:47 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:21:47 user nova-compute[74646]:       <target dev="tape2b76174-08"/>
Oct 26 16:21:47 user nova-compute[74646]:     </interface>
Oct 26 16:21:47 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:21:47 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/d3531167-c8a6-49b9-94af-90a95e6fd077/console.log" append="off"/>
Oct 26 16:21:47 user nova-compute[74646]:     </serial>
Oct 26 16:21:47 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:21:47 user nova-compute[74646]:     <video>
Oct 26 16:21:47 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:21:47 user nova-compute[74646]:     </video>
Oct 26 16:21:47 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:21:47 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:21:47 user nova-compute[74646]:     </rng>
Oct 26 16:21:47 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:21:47 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:21:47 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:21:47 user nova-compute[74646]:     </memballoon>
Oct 26 16:21:47 user nova-compute[74646]:   </devices>
Oct 26 16:21:47 user nova-compute[74646]: </domain>
Oct 26 16:21:47 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:21:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-488113707',display_name='tempest-ServerRescueNegativeTestJSON-server-488113707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-488113707',id=45,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dfed3c05e17482eaf314e0ab7cc1b83',ramdisk_id='',reservation_id='r-p7lalb6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-529562052',owner_user_name='tempest-ServerRescueNegativeTestJSON-529562052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:21:45Z,user_data=None,user_id='5b2d40e3a9404928a4c4d9dfb2356df8',uuid=d3531167-c8a6-49b9-94af-90a95e6fd077,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "address": "fa:16:3e:0c:5b:6a", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b76174-08", "ovs_interfaceid": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Converting VIF {"id": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "address": "fa:16:3e:0c:5b:6a", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b76174-08", "ovs_interfaceid": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:5b:6a,bridge_name='br-int',has_traffic_filtering=True,id=e2b76174-08e5-4617-bbcd-3ff30cb77286,network=Network(8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b76174-08') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG os_vif [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:5b:6a,bridge_name='br-int',has_traffic_filtering=True,id=e2b76174-08e5-4617-bbcd-3ff30cb77286,network=Network(8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b76174-08') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '899b3a24-f938-58fc-b200-65df144c2abd', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2b76174-08, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2b76174-08, col_values=(('qos', UUID('0ab60467-79eb-4495-ae80-f3b338072037')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2b76174-08, col_values=(('external_ids', {'iface-id': 'e2b76174-08e5-4617-bbcd-3ff30cb77286', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:5b:6a', 'vm-uuid': 'd3531167-c8a6-49b9-94af-90a95e6fd077'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0854c91c-fa7c-465e-83f5-3926305417fc/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Cannot resize image /opt/stack/data/nova/instances/0854c91c-fa7c-465e-83f5-3926305417fc/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Ensure instance console log exists: /opt/stack/data/nova/instances/0854c91c-fa7c-465e-83f5-3926305417fc/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:47 user nova-compute[74646]: INFO os_vif [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:5b:6a,bridge_name='br-int',has_traffic_filtering=True,id=e2b76174-08e5-4617-bbcd-3ff30cb77286,network=Network(8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2b76174-08')
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] No VIF found with MAC fa:16:3e:0c:5b:6a, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.compute.resource_tracker [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Compute_service record updated for user:user {{(pid=74646) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.426s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Successfully updated port: 830e8644-be9b-4687-880b-1da4629de476 {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Acquiring lock "refresh_cache-0854c91c-fa7c-465e-83f5-3926305417fc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Acquired lock "refresh_cache-0854c91c-fa7c-465e-83f5-3926305417fc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.compute.manager [req-8260773d-1927-4e89-a84e-6f7506a68dd1 req-0c2fc92b-3b94-4ec4-80bb-001da412eaf8 service nova] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Received event network-changed-830e8644-be9b-4687-880b-1da4629de476 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.compute.manager [req-8260773d-1927-4e89-a84e-6f7506a68dd1 req-0c2fc92b-3b94-4ec4-80bb-001da412eaf8 service nova] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Refreshing instance network info cache due to event network-changed-830e8644-be9b-4687-880b-1da4629de476. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8260773d-1927-4e89-a84e-6f7506a68dd1 req-0c2fc92b-3b94-4ec4-80bb-001da412eaf8 service nova] Acquiring lock "refresh_cache-0854c91c-fa7c-465e-83f5-3926305417fc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:21:47 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.network.neutron [req-119fd5de-819d-4a83-9f1a-4dcdf7b17635 req-d20c19b6-0140-452c-ae84-4be44d63c9e4 service nova] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Updated VIF entry in instance network info cache for port e2b76174-08e5-4617-bbcd-3ff30cb77286. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.network.neutron [req-119fd5de-819d-4a83-9f1a-4dcdf7b17635 req-d20c19b6-0140-452c-ae84-4be44d63c9e4 service nova] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Updating instance_info_cache with network_info: [{"id": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "address": "fa:16:3e:0c:5b:6a", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2b76174-08", "ovs_interfaceid": "e2b76174-08e5-4617-bbcd-3ff30cb77286", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-119fd5de-819d-4a83-9f1a-4dcdf7b17635 req-d20c19b6-0140-452c-ae84-4be44d63c9e4 service nova] Releasing lock "refresh_cache-d3531167-c8a6-49b9-94af-90a95e6fd077" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Updating instance_info_cache with network_info: [{"id": "830e8644-be9b-4687-880b-1da4629de476", "address": "fa:16:3e:21:06:ad", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8644-be", "ovs_interfaceid": "830e8644-be9b-4687-880b-1da4629de476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Releasing lock "refresh_cache-0854c91c-fa7c-465e-83f5-3926305417fc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Instance network_info: |[{"id": "830e8644-be9b-4687-880b-1da4629de476", "address": "fa:16:3e:21:06:ad", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8644-be", "ovs_interfaceid": "830e8644-be9b-4687-880b-1da4629de476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8260773d-1927-4e89-a84e-6f7506a68dd1 req-0c2fc92b-3b94-4ec4-80bb-001da412eaf8 service nova] Acquired lock "refresh_cache-0854c91c-fa7c-465e-83f5-3926305417fc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.network.neutron [req-8260773d-1927-4e89-a84e-6f7506a68dd1 req-0c2fc92b-3b94-4ec4-80bb-001da412eaf8 service nova] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Refreshing network info cache for port 830e8644-be9b-4687-880b-1da4629de476 {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Start _get_guest_xml network_info=[{"id": "830e8644-be9b-4687-880b-1da4629de476", "address": "fa:16:3e:21:06:ad", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8644-be", "ovs_interfaceid": "830e8644-be9b-4687-880b-1da4629de476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:21:48 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:21:48 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-445768691',display_name='tempest-ServerRescueNegativeTestJSON-server-445768691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-445768691',id=46,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dfed3c05e17482eaf314e0ab7cc1b83',ramdisk_id='',reservation_id='r-q5crt2ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-529562052',owner_user_name='tempest-ServerRescueNegativeTestJSON-529562052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:21:47Z,user_data=None,user_id='5b2d40e3a9404928a4c4d9dfb2356df8',uuid=0854c91c-fa7c-465e-83f5-3926305417fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "830e8644-be9b-4687-880b-1da4629de476", "address": "fa:16:3e:21:06:ad", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8644-be", "ovs_interfaceid": "830e8644-be9b-4687-880b-1da4629de476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Converting VIF {"id": "830e8644-be9b-4687-880b-1da4629de476", "address": "fa:16:3e:21:06:ad", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8644-be", "ovs_interfaceid": "830e8644-be9b-4687-880b-1da4629de476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:06:ad,bridge_name='br-int',has_traffic_filtering=True,id=830e8644-be9b-4687-880b-1da4629de476,network=Network(8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830e8644-be') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.objects.instance [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lazy-loading 'pci_devices' on Instance uuid 0854c91c-fa7c-465e-83f5-3926305417fc {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:21:48 user nova-compute[74646]:   <uuid>0854c91c-fa7c-465e-83f5-3926305417fc</uuid>
Oct 26 16:21:48 user nova-compute[74646]:   <name>instance-0000002e</name>
Oct 26 16:21:48 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:21:48 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:21:48 user nova-compute[74646]:   <metadata>
Oct 26 16:21:48 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:21:48 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:21:48 user nova-compute[74646]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-445768691</nova:name>
Oct 26 16:21:48 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:21:48</nova:creationTime>
Oct 26 16:21:48 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:21:48 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:21:48 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:21:48 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:21:48 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:21:48 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:21:48 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:21:48 user nova-compute[74646]:       <nova:owner>
Oct 26 16:21:48 user nova-compute[74646]:         <nova:user uuid="5b2d40e3a9404928a4c4d9dfb2356df8">tempest-ServerRescueNegativeTestJSON-529562052-project-member</nova:user>
Oct 26 16:21:48 user nova-compute[74646]:         <nova:project uuid="8dfed3c05e17482eaf314e0ab7cc1b83">tempest-ServerRescueNegativeTestJSON-529562052</nova:project>
Oct 26 16:21:48 user nova-compute[74646]:       </nova:owner>
Oct 26 16:21:48 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:21:48 user nova-compute[74646]:       <nova:ports>
Oct 26 16:21:48 user nova-compute[74646]:         <nova:port uuid="830e8644-be9b-4687-880b-1da4629de476">
Oct 26 16:21:48 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 26 16:21:48 user nova-compute[74646]:         </nova:port>
Oct 26 16:21:48 user nova-compute[74646]:       </nova:ports>
Oct 26 16:21:48 user nova-compute[74646]:     </nova:instance>
Oct 26 16:21:48 user nova-compute[74646]:   </metadata>
Oct 26 16:21:48 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:21:48 user nova-compute[74646]:     <system>
Oct 26 16:21:48 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:21:48 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:21:48 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:21:48 user nova-compute[74646]:       <entry name="serial">0854c91c-fa7c-465e-83f5-3926305417fc</entry>
Oct 26 16:21:48 user nova-compute[74646]:       <entry name="uuid">0854c91c-fa7c-465e-83f5-3926305417fc</entry>
Oct 26 16:21:48 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:21:48 user nova-compute[74646]:     </system>
Oct 26 16:21:48 user nova-compute[74646]:   </sysinfo>
Oct 26 16:21:48 user nova-compute[74646]:   <os>
Oct 26 16:21:48 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:21:48 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:21:48 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:21:48 user nova-compute[74646]:   </os>
Oct 26 16:21:48 user nova-compute[74646]:   <features>
Oct 26 16:21:48 user nova-compute[74646]:     <acpi/>
Oct 26 16:21:48 user nova-compute[74646]:     <apic/>
Oct 26 16:21:48 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:21:48 user nova-compute[74646]:   </features>
Oct 26 16:21:48 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:21:48 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:21:48 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:21:48 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:21:48 user nova-compute[74646]:   </clock>
Oct 26 16:21:48 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:21:48 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:21:48 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:21:48 user nova-compute[74646]:   </cpu>
Oct 26 16:21:48 user nova-compute[74646]:   <devices>
Oct 26 16:21:48 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:21:48 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:21:48 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/0854c91c-fa7c-465e-83f5-3926305417fc/disk"/>
Oct 26 16:21:48 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:21:48 user nova-compute[74646]:     </disk>
Oct 26 16:21:48 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:21:48 user nova-compute[74646]:       <mac address="fa:16:3e:21:06:ad"/>
Oct 26 16:21:48 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:21:48 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:21:48 user nova-compute[74646]:       <target dev="tap830e8644-be"/>
Oct 26 16:21:48 user nova-compute[74646]:     </interface>
Oct 26 16:21:48 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:21:48 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/0854c91c-fa7c-465e-83f5-3926305417fc/console.log" append="off"/>
Oct 26 16:21:48 user nova-compute[74646]:     </serial>
Oct 26 16:21:48 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:21:48 user nova-compute[74646]:     <video>
Oct 26 16:21:48 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:21:48 user nova-compute[74646]:     </video>
Oct 26 16:21:48 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:21:48 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:21:48 user nova-compute[74646]:     </rng>
Oct 26 16:21:48 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:21:48 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:21:48 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:21:48 user nova-compute[74646]:     </memballoon>
Oct 26 16:21:48 user nova-compute[74646]:   </devices>
Oct 26 16:21:48 user nova-compute[74646]: </domain>
Oct 26 16:21:48 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:21:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-445768691',display_name='tempest-ServerRescueNegativeTestJSON-server-445768691',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-445768691',id=46,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8dfed3c05e17482eaf314e0ab7cc1b83',ramdisk_id='',reservation_id='r-q5crt2ka',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-529562052',owner_user_name='tempest-ServerRescueNegativeTestJSON-529562052-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:21:47Z,user_data=None,user_id='5b2d40e3a9404928a4c4d9dfb2356df8',uuid=0854c91c-fa7c-465e-83f5-3926305417fc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "830e8644-be9b-4687-880b-1da4629de476", "address": "fa:16:3e:21:06:ad", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8644-be", "ovs_interfaceid": "830e8644-be9b-4687-880b-1da4629de476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Converting VIF {"id": "830e8644-be9b-4687-880b-1da4629de476", "address": "fa:16:3e:21:06:ad", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8644-be", "ovs_interfaceid": "830e8644-be9b-4687-880b-1da4629de476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:06:ad,bridge_name='br-int',has_traffic_filtering=True,id=830e8644-be9b-4687-880b-1da4629de476,network=Network(8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830e8644-be') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG os_vif [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:06:ad,bridge_name='br-int',has_traffic_filtering=True,id=830e8644-be9b-4687-880b-1da4629de476,network=Network(8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830e8644-be') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3ad251e-b77a-55b3-9c7d-33854737928a', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap830e8644-be, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap830e8644-be, col_values=(('qos', UUID('ce85229d-d003-4768-9070-e1a0d075f4d1')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap830e8644-be, col_values=(('external_ids', {'iface-id': '830e8644-be9b-4687-880b-1da4629de476', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:06:ad', 'vm-uuid': '0854c91c-fa7c-465e-83f5-3926305417fc'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:48 user nova-compute[74646]: INFO os_vif [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:06:ad,bridge_name='br-int',has_traffic_filtering=True,id=830e8644-be9b-4687-880b-1da4629de476,network=Network(8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap830e8644-be')
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] No VIF found with MAC fa:16:3e:21:06:ad, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.network.neutron [req-8260773d-1927-4e89-a84e-6f7506a68dd1 req-0c2fc92b-3b94-4ec4-80bb-001da412eaf8 service nova] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Updated VIF entry in instance network info cache for port 830e8644-be9b-4687-880b-1da4629de476. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG nova.network.neutron [req-8260773d-1927-4e89-a84e-6f7506a68dd1 req-0c2fc92b-3b94-4ec4-80bb-001da412eaf8 service nova] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Updating instance_info_cache with network_info: [{"id": "830e8644-be9b-4687-880b-1da4629de476", "address": "fa:16:3e:21:06:ad", "network": {"id": "8a77b8bc-efa6-4b6f-9bdc-53957acc0ac5", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1830704121-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8dfed3c05e17482eaf314e0ab7cc1b83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap830e8644-be", "ovs_interfaceid": "830e8644-be9b-4687-880b-1da4629de476", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:21:48 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-8260773d-1927-4e89-a84e-6f7506a68dd1 req-0c2fc92b-3b94-4ec4-80bb-001da412eaf8 service nova] Releasing lock "refresh_cache-0854c91c-fa7c-465e-83f5-3926305417fc" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-71d945f3-9590-4250-8905-44b23c40159a req-be339130-3ae3-4434-80a9-5632b6327d5f service nova] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Received event network-vif-plugged-830e8644-be9b-4687-880b-1da4629de476 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-71d945f3-9590-4250-8905-44b23c40159a req-be339130-3ae3-4434-80a9-5632b6327d5f service nova] Acquiring lock "0854c91c-fa7c-465e-83f5-3926305417fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-71d945f3-9590-4250-8905-44b23c40159a req-be339130-3ae3-4434-80a9-5632b6327d5f service nova] Lock "0854c91c-fa7c-465e-83f5-3926305417fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-71d945f3-9590-4250-8905-44b23c40159a req-be339130-3ae3-4434-80a9-5632b6327d5f service nova] Lock "0854c91c-fa7c-465e-83f5-3926305417fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-71d945f3-9590-4250-8905-44b23c40159a req-be339130-3ae3-4434-80a9-5632b6327d5f service nova] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] No waiting events found dispatching network-vif-plugged-830e8644-be9b-4687-880b-1da4629de476 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:21:50 user nova-compute[74646]: WARNING nova.compute.manager [req-71d945f3-9590-4250-8905-44b23c40159a req-be339130-3ae3-4434-80a9-5632b6327d5f service nova] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Received unexpected event network-vif-plugged-830e8644-be9b-4687-880b-1da4629de476 for instance with vm_state building and task_state spawning.
Oct 26 16:21:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-a722f81a-e672-4e66-af57-fec0168691f9 req-24dd936f-1bcb-400d-a3ea-66650f86958a service nova] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Received event network-vif-plugged-e2b76174-08e5-4617-bbcd-3ff30cb77286 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a722f81a-e672-4e66-af57-fec0168691f9 req-24dd936f-1bcb-400d-a3ea-66650f86958a service nova] Acquiring lock "d3531167-c8a6-49b9-94af-90a95e6fd077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a722f81a-e672-4e66-af57-fec0168691f9 req-24dd936f-1bcb-400d-a3ea-66650f86958a service nova] Lock "d3531167-c8a6-49b9-94af-90a95e6fd077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-a722f81a-e672-4e66-af57-fec0168691f9 req-24dd936f-1bcb-400d-a3ea-66650f86958a service nova] Lock "d3531167-c8a6-49b9-94af-90a95e6fd077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG nova.compute.manager [req-a722f81a-e672-4e66-af57-fec0168691f9 req-24dd936f-1bcb-400d-a3ea-66650f86958a service nova] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] No waiting events found dispatching network-vif-plugged-e2b76174-08e5-4617-bbcd-3ff30cb77286 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:21:50 user nova-compute[74646]: WARNING nova.compute.manager [req-a722f81a-e672-4e66-af57-fec0168691f9 req-24dd936f-1bcb-400d-a3ea-66650f86958a service nova] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Received unexpected event network-vif-plugged-e2b76174-08e5-4617-bbcd-3ff30cb77286 for instance with vm_state building and task_state spawning.
Oct 26 16:21:50 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:21:50 user nova-compute[74646]: DEBUG oslo_service.periodic_task [None req-dd56ef90-fa83-4cef-98a8-92a932ff91da None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74646) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 26 16:21:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:51 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-0b2bbd85-abd9-4414-b8b8-28e9393e0b06 req-7fc5cce8-cf30-401b-968e-dc312c37c552 service nova] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Received event network-vif-plugged-830e8644-be9b-4687-880b-1da4629de476 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0b2bbd85-abd9-4414-b8b8-28e9393e0b06 req-7fc5cce8-cf30-401b-968e-dc312c37c552 service nova] Acquiring lock "0854c91c-fa7c-465e-83f5-3926305417fc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0b2bbd85-abd9-4414-b8b8-28e9393e0b06 req-7fc5cce8-cf30-401b-968e-dc312c37c552 service nova] Lock "0854c91c-fa7c-465e-83f5-3926305417fc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-0b2bbd85-abd9-4414-b8b8-28e9393e0b06 req-7fc5cce8-cf30-401b-968e-dc312c37c552 service nova] Lock "0854c91c-fa7c-465e-83f5-3926305417fc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-0b2bbd85-abd9-4414-b8b8-28e9393e0b06 req-7fc5cce8-cf30-401b-968e-dc312c37c552 service nova] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] No waiting events found dispatching network-vif-plugged-830e8644-be9b-4687-880b-1da4629de476 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:21:52 user nova-compute[74646]: WARNING nova.compute.manager [req-0b2bbd85-abd9-4414-b8b8-28e9393e0b06 req-7fc5cce8-cf30-401b-968e-dc312c37c552 service nova] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Received unexpected event network-vif-plugged-830e8644-be9b-4687-880b-1da4629de476 for instance with vm_state building and task_state spawning.
Oct 26 16:21:52 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:21:52 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Instance spawned successfully.
Oct 26 16:21:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-5943b988-00a4-41ab-8b33-2c0eadb5c48f req-1250c3e6-a3cf-4443-a40d-3794082ad285 service nova] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Received event network-vif-plugged-e2b76174-08e5-4617-bbcd-3ff30cb77286 {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5943b988-00a4-41ab-8b33-2c0eadb5c48f req-1250c3e6-a3cf-4443-a40d-3794082ad285 service nova] Acquiring lock "d3531167-c8a6-49b9-94af-90a95e6fd077-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5943b988-00a4-41ab-8b33-2c0eadb5c48f req-1250c3e6-a3cf-4443-a40d-3794082ad285 service nova] Lock "d3531167-c8a6-49b9-94af-90a95e6fd077-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-5943b988-00a4-41ab-8b33-2c0eadb5c48f req-1250c3e6-a3cf-4443-a40d-3794082ad285 service nova] Lock "d3531167-c8a6-49b9-94af-90a95e6fd077-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:52 user nova-compute[74646]: DEBUG nova.compute.manager [req-5943b988-00a4-41ab-8b33-2c0eadb5c48f req-1250c3e6-a3cf-4443-a40d-3794082ad285 service nova] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] No waiting events found dispatching network-vif-plugged-e2b76174-08e5-4617-bbcd-3ff30cb77286 {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:21:52 user nova-compute[74646]: WARNING nova.compute.manager [req-5943b988-00a4-41ab-8b33-2c0eadb5c48f req-1250c3e6-a3cf-4443-a40d-3794082ad285 service nova] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Received unexpected event network-vif-plugged-e2b76174-08e5-4617-bbcd-3ff30cb77286 for instance with vm_state building and task_state spawning.
Oct 26 16:21:52 user nova-compute[74646]: INFO nova.compute.manager [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Took 6.33 seconds to spawn the instance on the hypervisor.
Oct 26 16:21:52 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:21:53 user nova-compute[74646]: DEBUG nova.compute.manager [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:21:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:21:53 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Instance spawned successfully.
Oct 26 16:21:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:21:53 user nova-compute[74646]: INFO nova.compute.manager [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: 0854c91c-fa7c-465e-83f5-3926305417fc] Took 7.09 seconds to build instance.
Oct 26 16:21:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:21:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:21:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:21:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:21:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:21:53 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:21:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a0c36c43-164f-46bc-9098-b8dcae19e73a tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "0854c91c-fa7c-465e-83f5-3926305417fc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.219s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:53 user nova-compute[74646]: INFO nova.compute.manager [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Took 7.58 seconds to spawn the instance on the hypervisor.
Oct 26 16:21:53 user nova-compute[74646]: DEBUG nova.compute.manager [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:21:53 user nova-compute[74646]: INFO nova.compute.manager [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] [instance: d3531167-c8a6-49b9-94af-90a95e6fd077] Took 8.12 seconds to build instance.
Oct 26 16:21:53 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-555ea714-a97c-47fd-8a46-dc4eb6dc29c3 tempest-ServerRescueNegativeTestJSON-529562052 tempest-ServerRescueNegativeTestJSON-529562052-project-member] Lock "d3531167-c8a6-49b9-94af-90a95e6fd077" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.210s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:21:53 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:56 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:21:58 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:01 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:03 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:08 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:22:11 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:13 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:15 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:16 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:18 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "a06b161c-8be5-4c44-bf46-ec9990290541" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "a06b161c-8be5-4c44-bf46-ec9990290541" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Starting instance... {{(pid=74646) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74646) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 26 16:22:19 user nova-compute[74646]: INFO nova.compute.claims [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Claim successful on node user
Oct 26 16:22:19 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Start building networks asynchronously for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Allocating IP information in the background. {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] allocate_for_instance() {{(pid=74646) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 26 16:22:19 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 26 16:22:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Start building block device mappings for instance. {{(pid=74646) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG nova.policy [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '41c8a2a8c5594cca9451ab93e681dcd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f24b251085ed49c991eef6c2df0b0990', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74646) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Start spawning the instance on the hypervisor. {{(pid=74646) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Creating instance directory {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 26 16:22:19 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Creating image(s)
Oct 26 16:22:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "/opt/stack/data/nova/instances/a06b161c-8be5-4c44-bf46-ec9990290541/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "/opt/stack/data/nova/instances/a06b161c-8be5-4c44-bf46-ec9990290541/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "/opt/stack/data/nova/instances/a06b161c-8be5-4c44-bf46-ec9990290541/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.195s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:22:19 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.199s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/a06b161c-8be5-4c44-bf46-ec9990290541/disk 1073741824 {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7,backing_fmt=raw /opt/stack/data/nova/instances/a06b161c-8be5-4c44-bf46-ec9990290541/disk 1073741824" returned: 0 in 0.055s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "999607f6456787fbf54e27d276eab7e4b8d8e4e7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Successfully created port: 9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b {{(pid=74646) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999607f6456787fbf54e27d276eab7e4b8d8e4e7 --force-share --output=json" returned: 0 in 0.178s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a06b161c-8be5-4c44-bf46-ec9990290541/disk. size=1073741824 {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06b161c-8be5-4c44-bf46-ec9990290541/disk --force-share --output=json {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG oslo_concurrency.processutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a06b161c-8be5-4c44-bf46-ec9990290541/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74646) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG nova.virt.disk.api [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Cannot resize image /opt/stack/data/nova/instances/a06b161c-8be5-4c44-bf46-ec9990290541/disk to a smaller size. {{(pid=74646) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Created local disks {{(pid=74646) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Ensure instance console log exists: /opt/stack/data/nova/instances/a06b161c-8be5-4c44-bf46-ec9990290541/console.log {{(pid=74646) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Successfully updated port: 9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b {{(pid=74646) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquiring lock "refresh_cache-a06b161c-8be5-4c44-bf46-ec9990290541" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Acquired lock "refresh_cache-a06b161c-8be5-4c44-bf46-ec9990290541" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Building network info cache for instance {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG nova.compute.manager [req-dcf6cba1-70e6-458f-bfea-ac131fbc79f7 req-0f6e358b-6a3a-4468-9528-07105beee9c9 service nova] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Received event network-changed-9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG nova.compute.manager [req-dcf6cba1-70e6-458f-bfea-ac131fbc79f7 req-0f6e358b-6a3a-4468-9528-07105beee9c9 service nova] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Refreshing instance network info cache due to event network-changed-9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b. {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dcf6cba1-70e6-458f-bfea-ac131fbc79f7 req-0f6e358b-6a3a-4468-9528-07105beee9c9 service nova] Acquiring lock "refresh_cache-a06b161c-8be5-4c44-bf46-ec9990290541" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 26 16:22:20 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Instance cache missing network info. {{(pid=74646) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.network.neutron [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Updating instance_info_cache with network_info: [{"id": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "address": "fa:16:3e:22:c0:4f", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8672ff-be", "ovs_interfaceid": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Releasing lock "refresh_cache-a06b161c-8be5-4c44-bf46-ec9990290541" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Instance network_info: |[{"id": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "address": "fa:16:3e:22:c0:4f", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8672ff-be", "ovs_interfaceid": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74646) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dcf6cba1-70e6-458f-bfea-ac131fbc79f7 req-0f6e358b-6a3a-4468-9528-07105beee9c9 service nova] Acquired lock "refresh_cache-a06b161c-8be5-4c44-bf46-ec9990290541" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.network.neutron [req-dcf6cba1-70e6-458f-bfea-ac131fbc79f7 req-0f6e358b-6a3a-4468-9528-07105beee9c9 service nova] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Refreshing network info cache for port 9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b {{(pid=74646) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Start _get_guest_xml network_info=[{"id": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "address": "fa:16:3e:22:c0:4f", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8672ff-be", "ovs_interfaceid": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encryption_secret_uuid': None, 'encryption_format': None, 'guest_format': None, 'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'encryption_options': None, 'image_id': '82af3b5f-8d68-4fc0-b4be-1ea2303721ff'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 26 16:22:21 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:22:21 user nova-compute[74646]: WARNING nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CPU controller missing on host. {{(pid=74646) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.host [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CPU controller found on host. {{(pid=74646) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74646) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-26T15:44:26Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-26T15:44:36Z,direct_url=<?>,disk_format='qcow2',id=82af3b5f-8d68-4fc0-b4be-1ea2303721ff,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='cfd55af27fc443b88a1416732a879d43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-26T15:44:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Flavor limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Image limits 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Flavor pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Image pref 0:0:0 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74646) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Got 1 possible topologies {{(pid=74646) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.hardware [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74646) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1965514878',display_name='tempest-AttachVolumeNegativeTest-server-1965514878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1965514878',id=47,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDq+t1mNfhbkuHlJWpXW4x2mm0xyvgWElIjCoHX7SADzKH662UFeOBt9J7hAiKf2XANcFdJWUnjm3oijVTJUPy2YTgW6899zP1ZQYi5rjr6+7KbfGksGKRu9quXuLq8RNA==',key_name='tempest-keypair-763392664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f24b251085ed49c991eef6c2df0b0990',ramdisk_id='',reservation_id='r-ji35g5tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-340789388',owner_user_name='tempest-AttachVolumeNegativeTest-340789388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:22:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41c8a2a8c5594cca9451ab93e681dcd0',uuid=a06b161c-8be5-4c44-bf46-ec9990290541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "address": "fa:16:3e:22:c0:4f", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8672ff-be", "ovs_interfaceid": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74646) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converting VIF {"id": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "address": "fa:16:3e:22:c0:4f", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8672ff-be", "ovs_interfaceid": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8672ff-be') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.objects.instance [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lazy-loading 'pci_devices' on Instance uuid a06b161c-8be5-4c44-bf46-ec9990290541 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] End _get_guest_xml xml=<domain type="kvm">
Oct 26 16:22:21 user nova-compute[74646]:   <uuid>a06b161c-8be5-4c44-bf46-ec9990290541</uuid>
Oct 26 16:22:21 user nova-compute[74646]:   <name>instance-0000002f</name>
Oct 26 16:22:21 user nova-compute[74646]:   <memory>524288</memory>
Oct 26 16:22:21 user nova-compute[74646]:   <vcpu>1</vcpu>
Oct 26 16:22:21 user nova-compute[74646]:   <metadata>
Oct 26 16:22:21 user nova-compute[74646]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 26 16:22:21 user nova-compute[74646]:       <nova:package version="0.0.0"/>
Oct 26 16:22:21 user nova-compute[74646]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1965514878</nova:name>
Oct 26 16:22:21 user nova-compute[74646]:       <nova:creationTime>2023-10-26 16:22:21</nova:creationTime>
Oct 26 16:22:21 user nova-compute[74646]:       <nova:flavor name="m1.tiny">
Oct 26 16:22:21 user nova-compute[74646]:         <nova:memory>512</nova:memory>
Oct 26 16:22:21 user nova-compute[74646]:         <nova:disk>1</nova:disk>
Oct 26 16:22:21 user nova-compute[74646]:         <nova:swap>0</nova:swap>
Oct 26 16:22:21 user nova-compute[74646]:         <nova:ephemeral>0</nova:ephemeral>
Oct 26 16:22:21 user nova-compute[74646]:         <nova:vcpus>1</nova:vcpus>
Oct 26 16:22:21 user nova-compute[74646]:       </nova:flavor>
Oct 26 16:22:21 user nova-compute[74646]:       <nova:owner>
Oct 26 16:22:21 user nova-compute[74646]:         <nova:user uuid="41c8a2a8c5594cca9451ab93e681dcd0">tempest-AttachVolumeNegativeTest-340789388-project-member</nova:user>
Oct 26 16:22:21 user nova-compute[74646]:         <nova:project uuid="f24b251085ed49c991eef6c2df0b0990">tempest-AttachVolumeNegativeTest-340789388</nova:project>
Oct 26 16:22:21 user nova-compute[74646]:       </nova:owner>
Oct 26 16:22:21 user nova-compute[74646]:       <nova:root type="image" uuid="82af3b5f-8d68-4fc0-b4be-1ea2303721ff"/>
Oct 26 16:22:21 user nova-compute[74646]:       <nova:ports>
Oct 26 16:22:21 user nova-compute[74646]:         <nova:port uuid="9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b">
Oct 26 16:22:21 user nova-compute[74646]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 26 16:22:21 user nova-compute[74646]:         </nova:port>
Oct 26 16:22:21 user nova-compute[74646]:       </nova:ports>
Oct 26 16:22:21 user nova-compute[74646]:     </nova:instance>
Oct 26 16:22:21 user nova-compute[74646]:   </metadata>
Oct 26 16:22:21 user nova-compute[74646]:   <sysinfo type="smbios">
Oct 26 16:22:21 user nova-compute[74646]:     <system>
Oct 26 16:22:21 user nova-compute[74646]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 26 16:22:21 user nova-compute[74646]:       <entry name="product">OpenStack Nova</entry>
Oct 26 16:22:21 user nova-compute[74646]:       <entry name="version">0.0.0</entry>
Oct 26 16:22:21 user nova-compute[74646]:       <entry name="serial">a06b161c-8be5-4c44-bf46-ec9990290541</entry>
Oct 26 16:22:21 user nova-compute[74646]:       <entry name="uuid">a06b161c-8be5-4c44-bf46-ec9990290541</entry>
Oct 26 16:22:21 user nova-compute[74646]:       <entry name="family">Virtual Machine</entry>
Oct 26 16:22:21 user nova-compute[74646]:     </system>
Oct 26 16:22:21 user nova-compute[74646]:   </sysinfo>
Oct 26 16:22:21 user nova-compute[74646]:   <os>
Oct 26 16:22:21 user nova-compute[74646]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 26 16:22:21 user nova-compute[74646]:     <boot dev="hd"/>
Oct 26 16:22:21 user nova-compute[74646]:     <smbios mode="sysinfo"/>
Oct 26 16:22:21 user nova-compute[74646]:   </os>
Oct 26 16:22:21 user nova-compute[74646]:   <features>
Oct 26 16:22:21 user nova-compute[74646]:     <acpi/>
Oct 26 16:22:21 user nova-compute[74646]:     <apic/>
Oct 26 16:22:21 user nova-compute[74646]:     <vmcoreinfo/>
Oct 26 16:22:21 user nova-compute[74646]:   </features>
Oct 26 16:22:21 user nova-compute[74646]:   <clock offset="utc">
Oct 26 16:22:21 user nova-compute[74646]:     <timer name="pit" tickpolicy="delay"/>
Oct 26 16:22:21 user nova-compute[74646]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 26 16:22:21 user nova-compute[74646]:     <timer name="hpet" present="no"/>
Oct 26 16:22:21 user nova-compute[74646]:   </clock>
Oct 26 16:22:21 user nova-compute[74646]:   <cpu mode="custom" match="exact">
Oct 26 16:22:21 user nova-compute[74646]:     <model>Nehalem</model>
Oct 26 16:22:21 user nova-compute[74646]:     <topology sockets="1" cores="1" threads="1"/>
Oct 26 16:22:21 user nova-compute[74646]:   </cpu>
Oct 26 16:22:21 user nova-compute[74646]:   <devices>
Oct 26 16:22:21 user nova-compute[74646]:     <disk type="file" device="disk">
Oct 26 16:22:21 user nova-compute[74646]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 26 16:22:21 user nova-compute[74646]:       <source file="/opt/stack/data/nova/instances/a06b161c-8be5-4c44-bf46-ec9990290541/disk"/>
Oct 26 16:22:21 user nova-compute[74646]:       <target dev="vda" bus="virtio"/>
Oct 26 16:22:21 user nova-compute[74646]:     </disk>
Oct 26 16:22:21 user nova-compute[74646]:     <interface type="ethernet">
Oct 26 16:22:21 user nova-compute[74646]:       <mac address="fa:16:3e:22:c0:4f"/>
Oct 26 16:22:21 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:22:21 user nova-compute[74646]:       <mtu size="1442"/>
Oct 26 16:22:21 user nova-compute[74646]:       <target dev="tap9f8672ff-be"/>
Oct 26 16:22:21 user nova-compute[74646]:     </interface>
Oct 26 16:22:21 user nova-compute[74646]:     <serial type="pty">
Oct 26 16:22:21 user nova-compute[74646]:       <log file="/opt/stack/data/nova/instances/a06b161c-8be5-4c44-bf46-ec9990290541/console.log" append="off"/>
Oct 26 16:22:21 user nova-compute[74646]:     </serial>
Oct 26 16:22:21 user nova-compute[74646]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 26 16:22:21 user nova-compute[74646]:     <video>
Oct 26 16:22:21 user nova-compute[74646]:       <model type="virtio"/>
Oct 26 16:22:21 user nova-compute[74646]:     </video>
Oct 26 16:22:21 user nova-compute[74646]:     <rng model="virtio">
Oct 26 16:22:21 user nova-compute[74646]:       <backend model="random">/dev/urandom</backend>
Oct 26 16:22:21 user nova-compute[74646]:     </rng>
Oct 26 16:22:21 user nova-compute[74646]:     <controller type="usb" index="0" model="none"/>
Oct 26 16:22:21 user nova-compute[74646]:     <memballoon model="virtio">
Oct 26 16:22:21 user nova-compute[74646]:       <stats period="10"/>
Oct 26 16:22:21 user nova-compute[74646]:     </memballoon>
Oct 26 16:22:21 user nova-compute[74646]:   </devices>
Oct 26 16:22:21 user nova-compute[74646]: </domain>
Oct 26 16:22:21 user nova-compute[74646]:  {{(pid=74646) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:22:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1965514878',display_name='tempest-AttachVolumeNegativeTest-server-1965514878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1965514878',id=47,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDq+t1mNfhbkuHlJWpXW4x2mm0xyvgWElIjCoHX7SADzKH662UFeOBt9J7hAiKf2XANcFdJWUnjm3oijVTJUPy2YTgW6899zP1ZQYi5rjr6+7KbfGksGKRu9quXuLq8RNA==',key_name='tempest-keypair-763392664',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f24b251085ed49c991eef6c2df0b0990',ramdisk_id='',reservation_id='r-ji35g5tp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-340789388',owner_user_name='tempest-AttachVolumeNegativeTest-340789388-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-26T16:22:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='41c8a2a8c5594cca9451ab93e681dcd0',uuid=a06b161c-8be5-4c44-bf46-ec9990290541,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "address": "fa:16:3e:22:c0:4f", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8672ff-be", "ovs_interfaceid": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converting VIF {"id": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "address": "fa:16:3e:22:c0:4f", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8672ff-be", "ovs_interfaceid": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8672ff-be') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG os_vif [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8672ff-be') {{(pid=74646) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a3c01c74-323d-53f6-8032-a58d4bade435', '_type': 'linux-noop'}}, row=False) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9f8672ff-be, may_exist=True, interface_attrs={}) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9f8672ff-be, col_values=(('qos', UUID('d535e918-c8d8-4a34-bd23-1dca5663e9bb')),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9f8672ff-be, col_values=(('external_ids', {'iface-id': '9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:c0:4f', 'vm-uuid': 'a06b161c-8be5-4c44-bf46-ec9990290541'}),), if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:21 user nova-compute[74646]: INFO os_vif [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:c0:4f,bridge_name='br-int',has_traffic_filtering=True,id=9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b,network=Network(61e7d372-590e-49c8-8594-e436a0e1c018),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9f8672ff-be')
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] No BDM found with device name vda, not building metadata. {{(pid=74646) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] No VIF found with MAC fa:16:3e:22:c0:4f, not building metadata {{(pid=74646) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.network.neutron [req-dcf6cba1-70e6-458f-bfea-ac131fbc79f7 req-0f6e358b-6a3a-4468-9528-07105beee9c9 service nova] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Updated VIF entry in instance network info cache for port 9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b. {{(pid=74646) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG nova.network.neutron [req-dcf6cba1-70e6-458f-bfea-ac131fbc79f7 req-0f6e358b-6a3a-4468-9528-07105beee9c9 service nova] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Updating instance_info_cache with network_info: [{"id": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "address": "fa:16:3e:22:c0:4f", "network": {"id": "61e7d372-590e-49c8-8594-e436a0e1c018", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-19941715-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f24b251085ed49c991eef6c2df0b0990", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9f8672ff-be", "ovs_interfaceid": "9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-dcf6cba1-70e6-458f-bfea-ac131fbc79f7 req-0f6e358b-6a3a-4468-9528-07105beee9c9 service nova] Releasing lock "refresh_cache-a06b161c-8be5-4c44-bf46-ec9990290541" {{(pid=74646) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 26 16:22:21 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Acquiring lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:22:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:22:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Acquiring lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:22:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:22:22 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:22:22 user nova-compute[74646]: INFO nova.compute.manager [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Terminating instance
Oct 26 16:22:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:22 user nova-compute[74646]: DEBUG nova.compute.manager [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Start destroying the instance on the hypervisor. {{(pid=74646) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 26 16:22:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:22 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG nova.compute.manager [req-37c35b07-90f0-45aa-9e19-ebadecc36297 req-54042745-11c2-41db-a6b6-0bf89ea0c969 service nova] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Received event network-vif-plugged-9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-37c35b07-90f0-45aa-9e19-ebadecc36297 req-54042745-11c2-41db-a6b6-0bf89ea0c969 service nova] Acquiring lock "a06b161c-8be5-4c44-bf46-ec9990290541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-37c35b07-90f0-45aa-9e19-ebadecc36297 req-54042745-11c2-41db-a6b6-0bf89ea0c969 service nova] Lock "a06b161c-8be5-4c44-bf46-ec9990290541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-37c35b07-90f0-45aa-9e19-ebadecc36297 req-54042745-11c2-41db-a6b6-0bf89ea0c969 service nova] Lock "a06b161c-8be5-4c44-bf46-ec9990290541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG nova.compute.manager [req-37c35b07-90f0-45aa-9e19-ebadecc36297 req-54042745-11c2-41db-a6b6-0bf89ea0c969 service nova] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] No waiting events found dispatching network-vif-plugged-9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:22:23 user nova-compute[74646]: WARNING nova.compute.manager [req-37c35b07-90f0-45aa-9e19-ebadecc36297 req-54042745-11c2-41db-a6b6-0bf89ea0c969 service nova] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Received unexpected event network-vif-plugged-9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b for instance with vm_state building and task_state spawning.
Oct 26 16:22:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:23 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Instance destroyed successfully.
Oct 26 16:22:23 user nova-compute[74646]: DEBUG nova.objects.instance [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lazy-loading 'resources' on Instance uuid c605a36d-d653-40d7-8fb1-cdcba29f3a19 {{(pid=74646) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG nova.virt.libvirt.vif [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-26T16:20:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-840508483',display_name='tempest-VolumesActionsTest-instance-840508483',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-840508483',id=44,image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-26T16:20:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='59dd17f01a8043d78909861b4649cd76',ramdisk_id='',reservation_id='r-ut9id5ke',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='82af3b5f-8d68-4fc0-b4be-1ea2303721ff',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-684642585',owner_user_name='tempest-VolumesActionsTest-684642585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-26T16:20:21Z,user_data=None,user_id='2f2e62ec681748589c721f9dde24d2ba',uuid=c605a36d-d653-40d7-8fb1-cdcba29f3a19,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "address": "fa:16:3e:8e:f6:84", "network": {"id": "57cf5edc-e523-4732-afa0-02f452cc448a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601411552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59dd17f01a8043d78909861b4649cd76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950d60ad-a0", "ovs_interfaceid": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Converting VIF {"id": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "address": "fa:16:3e:8e:f6:84", "network": {"id": "57cf5edc-e523-4732-afa0-02f452cc448a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1601411552-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "59dd17f01a8043d78909861b4649cd76", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap950d60ad-a0", "ovs_interfaceid": "950d60ad-a0b7-4766-8da6-358a1ff3970f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG nova.network.os_vif_util [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f6:84,bridge_name='br-int',has_traffic_filtering=True,id=950d60ad-a0b7-4766-8da6-358a1ff3970f,network=Network(57cf5edc-e523-4732-afa0-02f452cc448a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950d60ad-a0') {{(pid=74646) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG os_vif [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f6:84,bridge_name='br-int',has_traffic_filtering=True,id=950d60ad-a0b7-4766-8da6-358a1ff3970f,network=Network(57cf5edc-e523-4732-afa0-02f452cc448a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950d60ad-a0') {{(pid=74646) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap950d60ad-a0, bridge=br-int, if_exists=True) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ee536d1-8754-4a2e-9bcd-3a4e2a4383b1) {{(pid=74646) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:23 user nova-compute[74646]: INFO os_vif [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:f6:84,bridge_name='br-int',has_traffic_filtering=True,id=950d60ad-a0b7-4766-8da6-358a1ff3970f,network=Network(57cf5edc-e523-4732-afa0-02f452cc448a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap950d60ad-a0')
Oct 26 16:22:23 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Deleting instance files /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19_del
Oct 26 16:22:23 user nova-compute[74646]: INFO nova.virt.libvirt.driver [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Deletion of /opt/stack/data/nova/instances/c605a36d-d653-40d7-8fb1-cdcba29f3a19_del complete
Oct 26 16:22:23 user nova-compute[74646]: INFO nova.compute.manager [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 26 16:22:23 user nova-compute[74646]: DEBUG oslo.service.loopingcall [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74646) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG nova.compute.manager [-] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Deallocating network for instance {{(pid=74646) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 26 16:22:23 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] deallocate_for_instance() {{(pid=74646) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Oct 26 16:22:24 user nova-compute[74646]: DEBUG nova.network.neutron [-] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Updating instance_info_cache with network_info: [] {{(pid=74646) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 26 16:22:24 user nova-compute[74646]: INFO nova.compute.manager [-] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Took 0.52 seconds to deallocate network for instance.
Oct 26 16:22:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:22:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:22:24 user nova-compute[74646]: DEBUG nova.compute.provider_tree [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Inventory has not changed in ProviderTree for provider: 88f94598-b16e-4979-b37d-cf11430ad3e6 {{(pid=74646) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 26 16:22:24 user nova-compute[74646]: DEBUG nova.scheduler.client.report [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Inventory has not changed for provider 88f94598-b16e-4979-b37d-cf11430ad3e6 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74646) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 26 16:22:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:22:24 user nova-compute[74646]: INFO nova.scheduler.client.report [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Deleted allocations for instance c605a36d-d653-40d7-8fb1-cdcba29f3a19
Oct 26 16:22:24 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-c39970f1-5b7a-48cf-8be6-05378e5585aa tempest-VolumesActionsTest-684642585 tempest-VolumesActionsTest-684642585-project-member] Lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.937s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Received event network-vif-plugged-9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] Acquiring lock "a06b161c-8be5-4c44-bf46-ec9990290541-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] Lock "a06b161c-8be5-4c44-bf46-ec9990290541-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] Lock "a06b161c-8be5-4c44-bf46-ec9990290541-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] No waiting events found dispatching network-vif-plugged-9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:22:25 user nova-compute[74646]: WARNING nova.compute.manager [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Received unexpected event network-vif-plugged-9f8672ff-bea9-47c3-bf05-8dd1f8ebd26b for instance with vm_state building and task_state spawning.
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Received event network-vif-unplugged-950d60ad-a0b7-4766-8da6-358a1ff3970f {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] Acquiring lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] Lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] Lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] No waiting events found dispatching network-vif-unplugged-950d60ad-a0b7-4766-8da6-358a1ff3970f {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:22:25 user nova-compute[74646]: WARNING nova.compute.manager [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Received unexpected event network-vif-unplugged-950d60ad-a0b7-4766-8da6-358a1ff3970f for instance with vm_state deleted and task_state None.
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Received event network-vif-plugged-950d60ad-a0b7-4766-8da6-358a1ff3970f {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] Acquiring lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] Lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] Lock "c605a36d-d653-40d7-8fb1-cdcba29f3a19-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] No waiting events found dispatching network-vif-plugged-950d60ad-a0b7-4766-8da6-358a1ff3970f {{(pid=74646) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 26 16:22:25 user nova-compute[74646]: WARNING nova.compute.manager [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Received unexpected event network-vif-plugged-950d60ad-a0b7-4766-8da6-358a1ff3970f for instance with vm_state deleted and task_state None.
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.compute.manager [req-cabe1058-e61f-4472-852c-b16a3bffa62c req-6c061688-7705-4b7f-ab0f-eb7205b5b290 service nova] [instance: c605a36d-d653-40d7-8fb1-cdcba29f3a19] Received event network-vif-deleted-950d60ad-a0b7-4766-8da6-358a1ff3970f {{(pid=74646) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Instance event wait completed in 0 seconds for  {{(pid=74646) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Guest created on hypervisor {{(pid=74646) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 26 16:22:25 user nova-compute[74646]: INFO nova.virt.libvirt.driver [-] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Instance spawned successfully.
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Found default for hw_cdrom_bus of ide {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Found default for hw_disk_bus of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Found default for hw_input_bus of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Found default for hw_pointer_model of None {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Found default for hw_video_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.virt.libvirt.driver [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Found default for hw_vif_model of virtio {{(pid=74646) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 26 16:22:25 user nova-compute[74646]: INFO nova.compute.manager [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Took 5.59 seconds to spawn the instance on the hypervisor.
Oct 26 16:22:25 user nova-compute[74646]: DEBUG nova.compute.manager [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Checking state {{(pid=74646) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 26 16:22:25 user nova-compute[74646]: INFO nova.compute.manager [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] [instance: a06b161c-8be5-4c44-bf46-ec9990290541] Took 6.24 seconds to build instance.
Oct 26 16:22:25 user nova-compute[74646]: DEBUG oslo_concurrency.lockutils [None req-a84d03fe-1f45-4fd6-9488-836a3e1e3e42 tempest-AttachVolumeNegativeTest-340789388 tempest-AttachVolumeNegativeTest-340789388-project-member] Lock "a06b161c-8be5-4c44-bf46-ec9990290541" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.358s {{(pid=74646) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 26 16:22:26 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 26 16:22:28 user nova-compute[74646]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74646) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}